-- Logs begin at Sat 2022-10-29 20:01:14 UTC, end at Sat 2022-10-29 20:56:45 UTC. -- Oct 29 20:29:52.269408 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Oct 29 20:29:52.278457 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 29 20:29:52.280503 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 29 20:29:52 2022] *** Oct 29 20:29:52.280503 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 20:29:52.280503 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 20:29:52.280503 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: nodename: dv-osbrick-master-4-ceph Oct 29 20:29:52.280503 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: machine: x86_64 Oct 29 20:29:52.280503 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: clock source: unix Oct 29 20:29:52.280503 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: pcre jit disabled Oct 29 20:29:52.280503 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: detected number of CPU cores: 4 Oct 29 20:29:52.280503 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: current working directory: / Oct 29 20:29:52.280503 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: detected binary path: /usr/bin/uwsgi-core Oct 29 20:29:52.280503 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: your processes number limit is 47680 Oct 29 20:29:52.281097 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: your memory page size is 4096 bytes Oct 29 20:29:52.281097 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: detected max file descriptor number: 2048 Oct 29 20:29:52.281097 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: lock engine: pthread robust mutexes Oct 29 20:29:52.281097 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: thunder lock: enabled Oct 29 20:29:52.281097 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 29 20:29:52.281097 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 29 20:29:52.325469 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: Python main interpreter initialized at 0x561b750e99c0 Oct 29 20:29:52.325469 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: python threads support enabled Oct 29 20:29:52.325469 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: your server socket listen backlog is limited to 100 connections Oct 29 20:29:52.325469 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: your mercy for graceful operations on workers is 90 seconds Oct 29 20:29:52.325809 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 20:29:52.325884 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: *** Operational MODE: preforking *** Oct 29 20:29:52.326115 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: *** uWSGI is running in multiple interpreter mode *** Oct 29 20:29:52.326115 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: spawned uWSGI master process (pid: 88406) Oct 29 20:29:52.326312 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Oct 29 20:29:52.329212 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: spawned uWSGI worker 1 (pid: 88417, cores: 1) Oct 29 20:29:52.329212 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: spawned uWSGI worker 2 (pid: 88418, cores: 1) Oct 29 20:29:52.329212 dv-osbrick-master-4-ceph devstack@keystone.service[88406]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 20:29:56.937679 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 20:29:56.937679 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: from cryptography.utils import int_from_bytes Oct 29 20:29:56.938468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 20:29:56.938468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: from cryptography.utils import int_from_bytes Oct 29 20:29:56.938618 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 20:29:56.938618 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: from cryptography.utils import int_from_bytes Oct 29 20:29:56.939127 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 20:29:56.939127 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: from cryptography.utils import int_from_bytes Oct 29 20:29:56.988418 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 20:29:56.988593 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 20:29:56.988785 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] command line args: [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 20:29:56.989052 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 20:29:56.989228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ================================================================================ {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 20:29:56.989399 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 20:29:56.989486 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] admin_token = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.989598 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 20:29:56.989706 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] config_dir = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.989790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] command line args: [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 20:29:56.989892 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.990052 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 20:29:56.990134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] config_source = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.990234 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ================================================================================ {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 20:29:56.990317 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] debug = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.990428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.990686 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] admin_token = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.990756 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] config_dir = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.990819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.990948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.991035 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.991106 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] config_source = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.991209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.991288 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] debug = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.991462 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.991552 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.991696 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] list_limit = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.991773 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.991873 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] log_config_append = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.991951 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.992056 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.992159 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.992261 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] log_dir = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.992362 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.992469 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] log_file = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.992565 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] list_limit = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.992665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.992783 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] log_config_append = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.992868 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.992983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.993058 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.993177 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] log_dir = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.993251 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] log_file = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.993375 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.993457 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.993578 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.993654 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.993777 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.993856 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.993935 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.994050 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.994282 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.994358 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.994505 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.994586 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.994731 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.994815 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.994959 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.995041 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.995202 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.995279 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.995461 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.995539 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.995696 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.995826 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.995931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.996178 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.996260 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.996376 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] publish_errors = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.996457 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.996584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.996691 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.996813 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.996990 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.997189 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.997329 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.997412 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] publish_errors = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.997492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.997571 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.997675 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] standard_threads = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.997845 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.997967 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.998091 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.998213 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.998348 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.998476 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.998602 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.998732 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] use_journal = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.998732 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] use_json = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.998966 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] standard_threads = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.999143 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] use_stderr = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.999269 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.999429 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] use_syslog = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.999557 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.999694 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.999818 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:56.999952 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.000076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] use_journal = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:57.000076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] use_json = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:57.000310 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.000438 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] use_stderr = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:57.000518 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.000601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] use_syslog = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:57.000668 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.000741 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:29:57.000813 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.000887 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.000967 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.001038 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.001102 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.001168 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.001231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.001294 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.001359 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.001417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.001478 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.001535 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.001677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.001784 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.001945 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.002021 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.002144 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.002258 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.002375 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.002507 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.002617 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.002755 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.002857 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.002992 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.003646 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.003907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.003997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.004163 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.004298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.004403 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.004481 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.004635 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.004786 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.004885 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.004962 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.005142 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.005226 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.005389 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.005475 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.005632 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.005709 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.005859 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.005941 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.006086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.006171 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.006315 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.006391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.006546 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.006623 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.006788 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.006876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.007030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.007113 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.007257 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.007359 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.007510 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.007602 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.007752 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.007828 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.007993 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.008067 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.008224 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.008308 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.008458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.008533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.008682 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.008755 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.008913 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.008990 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.009143 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.009218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.009369 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.009447 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.009596 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.009673 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.009821 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.009898 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.010047 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.010123 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.010270 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.010343 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.010509 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.010584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.010733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.010814 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.010964 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.011041 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.011189 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.011270 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.011446 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.011533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.011680 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.011761 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.011915 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.011996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.012970 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.013141 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.013300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.013433 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.013562 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.013700 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.013837 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.013964 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.014100 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.014229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.015397 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.015488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.015595 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.015785 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.015843 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.015900 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.015964 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016024 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016089 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016149 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016269 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016329 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016386 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016449 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016741 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016806 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016865 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016931 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.016990 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017047 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017159 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017214 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017278 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017338 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017466 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017523 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017644 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017703 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017759 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017815 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.017920 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.018590 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.019522 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.019713 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.019916 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.020110 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.020295 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.020424 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.020561 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.020687 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.020768 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.020936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.021068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.021206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.021337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.021470 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.021595 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.021720 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.021845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.021988 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.022115 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.022239 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.022364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.022488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.022620 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.022756 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.022909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.023032 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.023162 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.023294 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.023428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.023563 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.023638 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.023708 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.023779 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.023855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.023927 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.024005 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.024086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.024168 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.024241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.024311 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.024381 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.024451 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.024519 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.024596 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.024668 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.024738 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.024817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.024889 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.024958 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.025036 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.025109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.025185 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.025326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.025396 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.025474 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.025545 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.025615 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.025684 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] auth.external = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.025820 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.025896 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.025975 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.026072 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.026158 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.026231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.026301 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.026372 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] auth.password = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.026442 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.026512 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] auth.token = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.026677 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] auth.external = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.026757 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.026912 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.026991 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.027175 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.027253 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.027440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.027528 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.027679 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] auth.password = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.027763 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.027914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] auth.token = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.028001 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.028140 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.028217 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.028374 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] credential.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.028470 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.028617 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.028708 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.028850 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.028927 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.029095 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.029178 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.029334 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.029420 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.029564 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.029641 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.029793 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.029869 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] credential.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.030037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.030123 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.030287 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.030365 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.030520 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.030597 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.030769 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.030854 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.031021 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.031101 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.031259 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.031357 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.031532 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.031627 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.031773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.031851 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.032017 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.032094 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.032248 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.032334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.032483 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.032562 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.032725 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.032803 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.032968 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.033054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.033196 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.033274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.033437 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.033522 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.033670 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.033926 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.034005 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.034159 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.034237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.034454 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.034537 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.034691 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.034773 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.034977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.035062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.035234 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.035359 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.035498 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.035582 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.035738 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.035817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.035972 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.036133 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.036210 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.036271 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.036440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.036521 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.036669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.036765 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.036904 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.036983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.037150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.037229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.037387 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.037477 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.037617 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.037695 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.037844 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.037922 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.038071 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.038157 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.038308 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.038386 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.038548 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.038621 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.038790 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.038870 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.039026 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.039104 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.039261 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.039371 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.039519 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.039643 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.039769 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.039848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.040000 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.040077 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.040227 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.040307 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.040459 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.040537 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.040686 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.040764 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.040919 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.040999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.041156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.041234 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.041392 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.041470 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.041636 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.041715 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.041862 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.041941 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.042105 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.042183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.042347 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.042432 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.042578 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.042663 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.042818 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.042895 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.043057 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.043135 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.043284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.043435 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.043621 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.043774 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.043854 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.044007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.044087 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.044239 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.044317 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.044476 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.044555 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.044708 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.044787 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.044941 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.045026 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.045172 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.045295 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.045414 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.045493 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.045640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.045717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.045868 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.046208 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.046377 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.046455 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.046617 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.046696 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.046849 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.046927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.047082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.047161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.047332 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.047417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.047564 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.047645 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.047803 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.047881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.048053 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.048130 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.048278 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.048357 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.048518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.048595 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.048758 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.048836 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.048990 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.049070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.049221 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.049298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.049445 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.049524 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.049675 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.049762 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.049951 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.050030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.050206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.050357 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.050458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.050593 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.050697 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.050839 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.050917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.051084 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.051164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.051354 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.051435 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.051600 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.051679 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.051843 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.051924 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.052069 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.052148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.052312 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.052396 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.052545 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.052625 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.052780 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.052859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.053012 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.053090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.053242 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.053321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.053484 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.053563 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.053722 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.053799 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.053960 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.054038 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.054196 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.054273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.054426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.054504 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.054666 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.054750 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.054898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.054976 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.055370 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.055461 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.055547 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.055622 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.055694 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.055764 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.055835 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.055906 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.056056 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.056136 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.056288 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.056367 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.056525 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.056603 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.056768 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.056846 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.057012 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.057095 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.057243 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.057320 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.057480 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.057559 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.057722 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.057799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.057953 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.058031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.058193 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.058273 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.058424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.058502 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.058657 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.058735 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.058876 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] role.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.058951 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.059117 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] role.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.059196 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.059364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.059449 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.059610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.059690 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.059848 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.059926 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.060088 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] role.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.060166 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.060327 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.060406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] role.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.060559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.060636 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.060797 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.060875 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.061038 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.061117 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.061278 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.061404 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.061508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.061587 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.061751 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.061832 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.061994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.062073 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.062236 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.062327 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.062478 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.062561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.062711 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.062872 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.062951 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.063106 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.063186 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.063374 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.063455 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.063638 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.063718 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.063873 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.064071 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.064150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.064312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.064390 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.064564 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.064650 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.064808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.064886 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.065043 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.065121 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.065271 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.065357 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.066013 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.066161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.066289 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.066414 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.066527 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.066618 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.066727 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.066808 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.066970 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.067049 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.067203 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.067290 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.067448 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.067519 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.067673 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.067774 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.067905 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] token.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.068034 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.068138 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.068284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.068382 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.068526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.068612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.068765 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.068843 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.068998 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.069076 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.069238 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] token.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.069325 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.069478 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.069556 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.069727 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.069805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.069967 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.070054 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.070202 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.070280 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.070436 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.070514 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.070667 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.070752 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.070908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.070986 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.071163 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.071240 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.071416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.071515 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.071656 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.071743 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.071895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.071972 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.072133 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.072212 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.connection = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.072381 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.072468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.072622 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.072699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.072855 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.072934 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.073093 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.073180 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.073324 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.073404 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.073556 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.073634 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.connection = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.073787 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.073865 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.074019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.074099 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.074263 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.074342 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.074496 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.074575 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.074736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.074815 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.074967 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.075046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.075202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.075280 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.075456 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.075537 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.075697 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.075776 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.075925 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.076006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.076161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.076240 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.076391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.076469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.076560 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 20:29:57.076640 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.076858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.077107 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.077342 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.077587 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.077826 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:29:57.077998 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 20:29:57.106482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.106707 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.106802 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.106930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.107019 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.107185 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.116025 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.116283 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.143363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.143592 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.144168 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.144273 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.197670 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.198000 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.246456 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.246692 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.247494 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.247735 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.312623 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.312858 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.313076 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.313234 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.313324 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.313477 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.313584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.313693 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.313776 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.313915 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.314135 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.314365 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.336784 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.336976 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.337071 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.337216 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.337319 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.337435 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.337520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.337655 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.337739 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.337871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.337955 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.338083 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.338165 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.338299 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.349696 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.350230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.362032 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.362263 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.362530 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.362691 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.362802 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.362923 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.363030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.363156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.363289 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.363468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.363548 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.363616 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.363817 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.364033 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 20:29:57.380139 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.380345 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 20:29:57.380683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.380766 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.380881 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 20:29:57.380964 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 20:29:57.381150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.381232 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.381410 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 20:29:57.381492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.381663 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.381744 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.381916 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.381997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.382183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.382439 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.391395 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.391673 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.391942 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.392024 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.392222 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.392305 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.392552 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.392836 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.399803 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.400375 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.402709 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.402994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.403273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.403431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.403582 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.403707 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.403860 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.403955 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.404123 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.404206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.404398 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.404480 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.404677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.404760 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.404945 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.405025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.405221 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.405301 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.405485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.405562 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.405764 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.406035 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.429327 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.429912 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.430781 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.431062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.431425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.431716 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.435629 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.435910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.436315 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.436603 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.437763 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.438482 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.444238 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.444523 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.445165 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.445456 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.448531 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.448775 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.449055 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.449447 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.449528 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.449726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.449817 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.450001 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.450084 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.450269 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.450399 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.450534 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.450686 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.450968 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.451243 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.451544 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.466837 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.467119 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.467974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.468258 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.470972 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.472241 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.474163 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.474572 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.475500 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.475915 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.478804 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.480165 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.481961 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.483326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.485089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.485391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.485673 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.486059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.486339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.486485 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.486615 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.486788 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.487076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.488014 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.488376 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.488660 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.503690 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.503973 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.504242 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.504507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.505047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.505345 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.505617 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.505888 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.511218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.512708 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.512901 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.514376 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.514511 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.514691 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.515958 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.516240 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.517338 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.517636 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.517918 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.518199 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.518476 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.519451 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.519736 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.520020 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.520314 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.520594 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.530482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.530766 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.531048 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.531346 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.531630 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.531906 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.531999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.532183 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.532266 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.532547 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.532815 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.533100 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.533377 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.533654 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.548076 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.549662 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.551704 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.553420 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.554602 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.556066 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.556362 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.557521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.557802 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.557886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.558085 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.559278 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.559588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.559885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.564553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.566081 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.566669 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.568193 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.568989 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.569279 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.569562 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.569835 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.571100 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.571426 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.571719 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.571996 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.577789 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.578085 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.578372 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.580094 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.580393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.580681 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.586938 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.587220 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.587525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.587803 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.588074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.588355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.588632 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.588913 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.589071 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 20:29:57.589190 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.589357 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.589459 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.589640 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.589767 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.589919 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.590001 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.590196 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.590277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.590479 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.590562 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.590771 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.591040 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.591338 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.591615 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.591888 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.592161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.592449 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.592713 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 20:29:57.624206 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561b750e99c0 pid: 88418 (default app) Oct 29 20:29:57.626479 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561b750e99c0 pid: 88417 (default app) Oct 29 20:29:57.627587 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318afae-a585-4524-b5a7-065dfb3d59f9 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:29:57.627870 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318afae-a585-4524-b5a7-065dfb3d59f9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:29:57.628197 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318afae-a585-4524-b5a7-065dfb3d59f9 None None] PATH_INFO: `/v3` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:29:57.632320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Sat Oct 29 20:29:57 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:04.874907 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cca80-eea8-4a6c-9a61-9fed7d0ab5ec None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:04.875531 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cca80-eea8-4a6c-9a61-9fed7d0ab5ec None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:04.875531 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cca80-eea8-4a6c-9a61-9fed7d0ab5ec None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:04.880730 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:30:04.885964 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3d481-077e-49d3-a6e7-e59e02e017fe None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:04.886563 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3d481-077e-49d3-a6e7-e59e02e017fe None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:04.886563 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3d481-077e-49d3-a6e7-e59e02e017fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:04.963813 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: INFO dbcounter [None req-e6a3d481-077e-49d3-a6e7-e59e02e017fe None None] Registered counter for database keystone Oct 29 20:30:04.982465 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG oslo_db.sqlalchemy.engines [None req-e6a3d481-077e-49d3-a6e7-e59e02e017fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:30:04.989329 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writer thread running {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:30:05.165458 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG passlib.handlers.bcrypt [None req-e6a3d481-077e-49d3-a6e7-e59e02e017fe None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88418) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 29 20:30:05.165840 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG passlib.handlers.bcrypt [None req-e6a3d481-077e-49d3-a6e7-e59e02e017fe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88418) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 29 20:30:05.224778 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-e6a3d481-077e-49d3-a6e7-e59e02e017fe None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:05.226370 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e6a3d481-077e-49d3-a6e7-e59e02e017fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:05.355505 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 29 20:30:05.874097 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cca80-eea8-4a6c-9a61-9fed7d0ab5ec None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:05.952388 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: INFO dbcounter [None req-423cca80-eea8-4a6c-9a61-9fed7d0ab5ec None None] Registered counter for database keystone Oct 29 20:30:05.974159 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG oslo_db.sqlalchemy.engines [None req-423cca80-eea8-4a6c-9a61-9fed7d0ab5ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:30:05.980273 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writer thread running {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:30:06.098204 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cca80-eea8-4a6c-9a61-9fed7d0ab5ec None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:06.102458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb97ca-8454-43d4-8fc8-9c542b27da6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:06.103075 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb97ca-8454-43d4-8fc8-9c542b27da6b admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:06.103373 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb97ca-8454-43d4-8fc8-9c542b27da6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:06.103646 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb97ca-8454-43d4-8fc8-9c542b27da6b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:06.111732 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb97ca-8454-43d4-8fc8-9c542b27da6b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:06.163642 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9ddb97ca-8454-43d4-8fc8-9c542b27da6b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 29 20:30:06.163983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb97ca-8454-43d4-8fc8-9c542b27da6b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:06.173400 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Sat Oct 29 20:30:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 20:30:06.180001 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3d481-077e-49d3-a6e7-e59e02e017fe None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:06.197086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3d481-077e-49d3-a6e7-e59e02e017fe None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:06.201546 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a21bf-315f-4aa7-ab91-c89b991806e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:06.202650 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a21bf-315f-4aa7-ab91-c89b991806e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:06.202931 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a21bf-315f-4aa7-ab91-c89b991806e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:06.203202 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a21bf-315f-4aa7-ab91-c89b991806e2 admin admin] PATH_INFO: `/v3/projects/5ed5676f4e9241dc85909bd15e1b9406` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:06.207021 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a21bf-315f-4aa7-ab91-c89b991806e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ed5676f4e9241dc85909bd15e1b9406)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:06.258396 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: WARNING keystone.common.rbac_enforcer.enforcer [None req-549a21bf-315f-4aa7-ab91-c89b991806e2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 29 20:30:06.258748 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a21bf-315f-4aa7-ab91-c89b991806e2 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:06.263421 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Sat Oct 29 20:30:06 2022] GET /identity/v3/projects/5ed5676f4e9241dc85909bd15e1b9406 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:08.628572 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e3343-97ca-4d5d-b72e-fd20e3272f7e None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:08.629071 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e3343-97ca-4d5d-b72e-fd20e3272f7e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:08.629071 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e3343-97ca-4d5d-b72e-fd20e3272f7e None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:08.633153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:30:08.638613 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad9a41-bcd2-419f-988c-d10db7575c7e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:08.639004 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad9a41-bcd2-419f-988c-d10db7575c7e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:08.639163 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad9a41-bcd2-419f-988c-d10db7575c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:08.659784 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-88ad9a41-bcd2-419f-988c-d10db7575c7e None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:08.661282 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-88ad9a41-bcd2-419f-988c-d10db7575c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:08.669167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 29 20:30:08.987842 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e3343-97ca-4d5d-b72e-fd20e3272f7e None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:08.999910 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e3343-97ca-4d5d-b72e-fd20e3272f7e None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:09.004596 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ae154-e488-42c2-907f-5022e22bfe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:09.005192 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ae154-e488-42c2-907f-5022e22bfe3a admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:09.005469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ae154-e488-42c2-907f-5022e22bfe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:09.005739 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ae154-e488-42c2-907f-5022e22bfe3a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:09.013240 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ae154-e488-42c2-907f-5022e22bfe3a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:09.015016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ae154-e488-42c2-907f-5022e22bfe3a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:09.024276 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Sat Oct 29 20:30:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 20:30:09.029468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad9a41-bcd2-419f-988c-d10db7575c7e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:09.038548 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad9a41-bcd2-419f-988c-d10db7575c7e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:09.042866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3a1c8-6ba1-442a-97dd-477fa05a8cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:09.043513 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3a1c8-6ba1-442a-97dd-477fa05a8cba admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:09.043793 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3a1c8-6ba1-442a-97dd-477fa05a8cba admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:09.044064 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3a1c8-6ba1-442a-97dd-477fa05a8cba admin admin] PATH_INFO: `/v3/users/f9beafc3b84548cf9fb3d264e0f50848` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:09.045365 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3a1c8-6ba1-442a-97dd-477fa05a8cba admin admin] RBAC: Authorizing `identity:get_user(user_id=f9beafc3b84548cf9fb3d264e0f50848)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:09.047479 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3a1c8-6ba1-442a-97dd-477fa05a8cba admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:09.048980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Sat Oct 29 20:30:09 2022] GET /identity/v3/users/f9beafc3b84548cf9fb3d264e0f50848 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:11.480846 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356128c-efa7-49c1-bbf6-9d0b016ce0e7 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:11.481382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356128c-efa7-49c1-bbf6-9d0b016ce0e7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:11.481382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356128c-efa7-49c1-bbf6-9d0b016ce0e7 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:11.482699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:11.488677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c23c82-e6c4-491f-9d70-706b80c5078a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:11.489085 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c23c82-e6c4-491f-9d70-706b80c5078a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:11.489229 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c23c82-e6c4-491f-9d70-706b80c5078a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:11.507392 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-47c23c82-e6c4-491f-9d70-706b80c5078a None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:11.508489 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-47c23c82-e6c4-491f-9d70-706b80c5078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:11.531387 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f414-373e-465b-906a-91262f8ef6c0 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:11.531670 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f414-373e-465b-906a-91262f8ef6c0 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:11.531944 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f414-373e-465b-906a-91262f8ef6c0 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:11.533249 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:30:11.539162 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17501d-ca58-4155-836b-a56cb70ec83f None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:11.539481 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17501d-ca58-4155-836b-a56cb70ec83f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:11.539752 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17501d-ca58-4155-836b-a56cb70ec83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:11.581435 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG passlib.handlers.bcrypt [None req-cf17501d-ca58-4155-836b-a56cb70ec83f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88417) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 29 20:30:11.581974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG passlib.handlers.bcrypt [None req-cf17501d-ca58-4155-836b-a56cb70ec83f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88417) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 29 20:30:11.594423 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:11.630769 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-cf17501d-ca58-4155-836b-a56cb70ec83f None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:11.632361 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cf17501d-ca58-4155-836b-a56cb70ec83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:11.732047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:30:11.918437 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c23c82-e6c4-491f-9d70-706b80c5078a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:11.942819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:12.068754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17501d-ca58-4155-836b-a56cb70ec83f None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:12.134447 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c23c82-e6c4-491f-9d70-706b80c5078a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:12.169309 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157567c-309a-4074-832b-fc848851b029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:12.169907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157567c-309a-4074-832b-fc848851b029 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:12.170186 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157567c-309a-4074-832b-fc848851b029 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:12.170465 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157567c-309a-4074-832b-fc848851b029 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:12.172778 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17501d-ca58-4155-836b-a56cb70ec83f None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:12.175277 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:12.182164 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157567c-309a-4074-832b-fc848851b029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-e157567c-309a-4074-832b-fc848851b029 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:12.191930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:12.193086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:12.194059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:12.194059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:12.194059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:12.194059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:12.194059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:12.194059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:12.194059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:12.194059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:12.194059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:12.194059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:12.194059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:30:12.194059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:30:12.194059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Sat Oct 29 20:30:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:12.198913 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157567c-309a-4074-832b-fc848851b029 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:12.214295 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d46d7f-db35-41a4-ad5c-13066aecf635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:12.215147 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d46d7f-db35-41a4-ad5c-13066aecf635 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:12.215457 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d46d7f-db35-41a4-ad5c-13066aecf635 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:12.215725 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d46d7f-db35-41a4-ad5c-13066aecf635 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:12.216666 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d46d7f-db35-41a4-ad5c-13066aecf635 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:12.218126 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d46d7f-db35-41a4-ad5c-13066aecf635 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:12.229369 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.sql.core [None req-58d46d7f-db35-41a4-ad5c-13066aecf635 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 29 20:30:12.229369 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 20:30:12.229369 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [parameters: {'id': '475d7536207d40939dc7ce1836284f18', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 29 20:30:12.229369 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88417) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 20:30:12.247664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-58d46d7f-db35-41a4-ad5c-13066aecf635 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 29 20:30:12.247664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:12.247664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 20:30:12.247664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 20:30:12.247664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 20:30:12.247664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 20:30:12.247664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 20:30:12.247664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 20:30:12.247664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 20:30:12.247664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application conn.query(q) Oct 29 20:30:12.247664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 20:30:12.247664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 20:30:12.247664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 20:30:12.247664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application result.read() Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 29 20:30:12.248653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application next(self.gen) Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application yield resource Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application next(self.gen) Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.session.rollback() Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.force_reraise() Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise self.value Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application session.commit() Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 29 20:30:12.249759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._prepare_impl() Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.session.flush() Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._flush(objects) Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application compat.raise_( Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application flush_context.execute() Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rec.execute(self) Oct 29 20:30:12.250770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 20:30:12.251920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application conn.query(q) Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application result.read() Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 20:30:12.253298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [parameters: {'id': '475d7536207d40939dc7ce1836284f18', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 29 20:30:12.254985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:12.256458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:12.257895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 29 20:30:12.257895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 29 20:30:12.257895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:12.257895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:12.257895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 29 20:30:12.257895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 29 20:30:12.257895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:12.257895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:12.257895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 29 20:30:12.257895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 29 20:30:12.257895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 29 20:30:12.257895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:12.257895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 8/15] 10.222.0.40 () {60 vars in 1137 bytes} [Sat Oct 29 20:30:12 2022] POST /identity/v3/domains => generated 190 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:30:12.257895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d46d7f-db35-41a4-ad5c-13066aecf635 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:12.291983 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:12.310883 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157567c-309a-4074-832b-fc848851b029 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:12.344800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a1645-3591-4171-9161-1d5135a90fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:12.345405 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a1645-3591-4171-9161-1d5135a90fcb None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:12.345682 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a1645-3591-4171-9161-1d5135a90fcb None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:12.345956 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a1645-3591-4171-9161-1d5135a90fcb None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:12.346673 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a1645-3591-4171-9161-1d5135a90fcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:12.346976 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a1645-3591-4171-9161-1d5135a90fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:12.348404 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a1645-3591-4171-9161-1d5135a90fcb None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:12.357017 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d46d7f-db35-41a4-ad5c-13066aecf635 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:12.360723 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 8/16] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:30:12.366889 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a1645-3591-4171-9161-1d5135a90fcb None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:12.391485 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b6bab-dee0-4639-81ca-0e845ec79e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:12.392336 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b6bab-dee0-4639-81ca-0e845ec79e53 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:12.392610 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b6bab-dee0-4639-81ca-0e845ec79e53 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:12.392874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b6bab-dee0-4639-81ca-0e845ec79e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:12.411523 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b6bab-dee0-4639-81ca-0e845ec79e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:12.412991 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b6bab-dee0-4639-81ca-0e845ec79e53 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-552b6bab-dee0-4639-81ca-0e845ec79e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:30:12.429974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:12.430853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:30:12.431825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:30:12.431825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:30:12.431825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:12.431825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:30:12.436659 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b6bab-dee0-4639-81ca-0e845ec79e53 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:12.462678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:12.466434 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a1645-3591-4171-9161-1d5135a90fcb None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:12.501743 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452d876-5311-45b0-bc25-d16f33ea61d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:12.502392 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452d876-5311-45b0-bc25-d16f33ea61d4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:12.503353 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452d876-5311-45b0-bc25-d16f33ea61d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:12.503975 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452d876-5311-45b0-bc25-d16f33ea61d4 None admin] PATH_INFO: `/v3/users/f9beafc3b84548cf9fb3d264e0f50848` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:12.505109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452d876-5311-45b0-bc25-d16f33ea61d4 None admin] RBAC: Authorizing `identity:get_user(user_id=f9beafc3b84548cf9fb3d264e0f50848)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:12.506671 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452d876-5311-45b0-bc25-d16f33ea61d4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:12.508155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 9/18] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:12 2022] GET /identity/v3/users/f9beafc3b84548cf9fb3d264e0f50848 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:30:12.513574 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452d876-5311-45b0-bc25-d16f33ea61d4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:12.534400 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:12.629448 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452d876-5311-45b0-bc25-d16f33ea61d4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:12.651190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b6bab-dee0-4639-81ca-0e845ec79e53 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:12.664991 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68aca9-c3c9-4368-96db-4d0dc3aad06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:12.665620 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68aca9-c3c9-4368-96db-4d0dc3aad06e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:12.665898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68aca9-c3c9-4368-96db-4d0dc3aad06e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:12.666170 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68aca9-c3c9-4368-96db-4d0dc3aad06e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:12.667282 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68aca9-c3c9-4368-96db-4d0dc3aad06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:12.668772 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68aca9-c3c9-4368-96db-4d0dc3aad06e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:12.670310 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 10/19] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:30:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:30:12.676601 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68aca9-c3c9-4368-96db-4d0dc3aad06e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:12.688749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bdac7-e109-4047-a23a-3fd10d129d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:12.689288 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bdac7-e109-4047-a23a-3fd10d129d86 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:12.689561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bdac7-e109-4047-a23a-3fd10d129d86 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:12.689828 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bdac7-e109-4047-a23a-3fd10d129d86 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:12.690931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bdac7-e109-4047-a23a-3fd10d129d86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:12.691234 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bdac7-e109-4047-a23a-3fd10d129d86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:12.692632 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bdac7-e109-4047-a23a-3fd10d129d86 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:12.710947 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 10/20] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:30:12.762386 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:12.785105 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68aca9-c3c9-4368-96db-4d0dc3aad06e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:12.821668 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193103b3-4376-4ff8-b0e7-31330e27c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:12.822343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193103b3-4376-4ff8-b0e7-31330e27c3de None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:12.822623 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193103b3-4376-4ff8-b0e7-31330e27c3de None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:12.822905 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193103b3-4376-4ff8-b0e7-31330e27c3de None admin] PATH_INFO: `/v3/domains/default/users/f9beafc3b84548cf9fb3d264e0f50848/roles/9b15e747c88749bfb25139f3bd80b395` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:12.824914 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193103b3-4376-4ff8-b0e7-31330e27c3de None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f9beafc3b84548cf9fb3d264e0f50848, role_id=9b15e747c88749bfb25139f3bd80b395)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:12.826388 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193103b3-4376-4ff8-b0e7-31330e27c3de None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:12.950568 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 11/21] 10.222.0.40 () {58 vars in 1361 bytes} [Sat Oct 29 20:30:12 2022] PUT /identity/v3/domains/default/users/f9beafc3b84548cf9fb3d264e0f50848/roles/9b15e747c88749bfb25139f3bd80b395 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 20:30:15.761119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea4d80-0fd0-4e53-b27c-4b916390a2f6 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:15.761641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea4d80-0fd0-4e53-b27c-4b916390a2f6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:15.761641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea4d80-0fd0-4e53-b27c-4b916390a2f6 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:15.762988 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 11/22] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:15.769562 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d56e-15fc-4a3a-9a1d-3ad59487c197 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:15.770025 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d56e-15fc-4a3a-9a1d-3ad59487c197 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:15.770108 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d56e-15fc-4a3a-9a1d-3ad59487c197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:15.801493 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7bb3d56e-15fc-4a3a-9a1d-3ad59487c197 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:15.803079 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7bb3d56e-15fc-4a3a-9a1d-3ad59487c197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:15.823968 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b82c1-ed86-4692-8731-554d26a215d1 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:15.824606 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b82c1-ed86-4692-8731-554d26a215d1 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:15.825120 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b82c1-ed86-4692-8731-554d26a215d1 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:15.826724 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 12/23] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:30:15.832550 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46da86e-7bdf-437d-b5e1-e5b102528cc6 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:15.833124 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46da86e-7bdf-437d-b5e1-e5b102528cc6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:15.833625 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46da86e-7bdf-437d-b5e1-e5b102528cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:15.866953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-d46da86e-7bdf-437d-b5e1-e5b102528cc6 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:15.868920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d46da86e-7bdf-437d-b5e1-e5b102528cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:15.949834 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 12/24] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:30:15.996630 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 13/25] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:30:16.180147 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113d651-21d5-4f8a-bc9a-151066a98ab9 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:16.180533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113d651-21d5-4f8a-bc9a-151066a98ab9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:16.180710 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113d651-21d5-4f8a-bc9a-151066a98ab9 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:16.184873 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 13/26] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:16.190347 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e8acd-4c6a-4def-9bf5-ae7c17315413 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:16.190672 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e8acd-4c6a-4def-9bf5-ae7c17315413 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:16.190960 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e8acd-4c6a-4def-9bf5-ae7c17315413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:16.216667 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-a85e8acd-4c6a-4def-9bf5-ae7c17315413 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:16.217855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a85e8acd-4c6a-4def-9bf5-ae7c17315413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:16.221475 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:16.313780 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 14/27] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:16.390956 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113d651-21d5-4f8a-bc9a-151066a98ab9 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:16.469270 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:16.515073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113d651-21d5-4f8a-bc9a-151066a98ab9 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:16.552526 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a518e12-13c8-40e4-a03e-daacd16089ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:16.553164 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a518e12-13c8-40e4-a03e-daacd16089ed None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:16.553447 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a518e12-13c8-40e4-a03e-daacd16089ed None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:16.553724 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a518e12-13c8-40e4-a03e-daacd16089ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:16.564356 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a518e12-13c8-40e4-a03e-daacd16089ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-6a518e12-13c8-40e4-a03e-daacd16089ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:16.570428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:16.571264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:16.572037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:16.572037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:16.572037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:16.572037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:16.572037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:16.572037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:16.572037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:16.572037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:16.572037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:16.572037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:16.572037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:30:16.572037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:30:16.575436 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 14/28] 10.222.0.40 () {56 vars in 1096 bytes} [Sat Oct 29 20:30:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:16.577863 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e8acd-4c6a-4def-9bf5-ae7c17315413 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:16.590408 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a518e12-13c8-40e4-a03e-daacd16089ed None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:16.717966 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e8acd-4c6a-4def-9bf5-ae7c17315413 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:16.759681 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9829513-b58a-456a-8465-247cf1b00cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:16.760609 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9829513-b58a-456a-8465-247cf1b00cd2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:16.761102 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9829513-b58a-456a-8465-247cf1b00cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:16.761641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9829513-b58a-456a-8465-247cf1b00cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:16.763024 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9829513-b58a-456a-8465-247cf1b00cd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:16.763574 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9829513-b58a-456a-8465-247cf1b00cd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:16.769039 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9829513-b58a-456a-8465-247cf1b00cd2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:16.785721 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 15/29] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:16.787414 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a166a-04cc-4024-98e3-39dcf81551c6 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:16.787954 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a166a-04cc-4024-98e3-39dcf81551c6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:16.788449 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a166a-04cc-4024-98e3-39dcf81551c6 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:16.790119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:16.790221 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a518e12-13c8-40e4-a03e-daacd16089ed None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:16.791682 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a166a-04cc-4024-98e3-39dcf81551c6 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:16.797464 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:16.864214 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:16.874023 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8099c-6e31-4b6a-ad69-fd7d0fcf2273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:16.874995 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8099c-6e31-4b6a-ad69-fd7d0fcf2273 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:16.875510 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8099c-6e31-4b6a-ad69-fd7d0fcf2273 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:16.876080 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8099c-6e31-4b6a-ad69-fd7d0fcf2273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:16.890316 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8099c-6e31-4b6a-ad69-fd7d0fcf2273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:16.892550 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8099c-6e31-4b6a-ad69-fd7d0fcf2273 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-7bb8099c-6e31-4b6a-ad69-fd7d0fcf2273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:30:16.912223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:16.913148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:30:16.913925 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:30:16.913925 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:30:16.913925 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:30:16.916119 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 15/31] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:30:16.917847 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19b7f6-a6b2-4985-9e92-d78e5419523b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:16.918397 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19b7f6-a6b2-4985-9e92-d78e5419523b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:16.918866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19b7f6-a6b2-4985-9e92-d78e5419523b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:16.919588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a166a-04cc-4024-98e3-39dcf81551c6 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:16.945297 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-5f19b7f6-a6b2-4985-9e92-d78e5419523b None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:16.947000 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5f19b7f6-a6b2-4985-9e92-d78e5419523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:16.962048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2503be-9b41-420c-ace1-bd4a6df093c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:16.962697 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2503be-9b41-420c-ace1-bd4a6df093c7 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:16.962973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2503be-9b41-420c-ace1-bd4a6df093c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:16.963244 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2503be-9b41-420c-ace1-bd4a6df093c7 None admin] PATH_INFO: `/v3/users/f9beafc3b84548cf9fb3d264e0f50848` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:16.964635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2503be-9b41-420c-ace1-bd4a6df093c7 None admin] RBAC: Authorizing `identity:get_user(user_id=f9beafc3b84548cf9fb3d264e0f50848)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:16.966206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2503be-9b41-420c-ace1-bd4a6df093c7 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:16.973136 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 17/32] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:16 2022] GET /identity/v3/users/f9beafc3b84548cf9fb3d264e0f50848 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:16.973136 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2503be-9b41-420c-ace1-bd4a6df093c7 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:17.034822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 16/33] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:17.036264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19b7f6-a6b2-4985-9e92-d78e5419523b None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:17.052012 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:17.086678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2503be-9b41-420c-ace1-bd4a6df093c7 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:17.124892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8cce8-9651-4e46-bf84-8807743dee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:17.125379 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8cce8-9651-4e46-bf84-8807743dee8f None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:17.125750 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8cce8-9651-4e46-bf84-8807743dee8f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:17.126114 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8cce8-9651-4e46-bf84-8807743dee8f None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:17.127027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8cce8-9651-4e46-bf84-8807743dee8f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:17.129155 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8cce8-9651-4e46-bf84-8807743dee8f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:17.157392 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19b7f6-a6b2-4985-9e92-d78e5419523b None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:17.181780 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:17.215282 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7832162-c8c8-489f-97e2-e2799dc611d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:17.216157 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7832162-c8c8-489f-97e2-e2799dc611d0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:17.216579 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7832162-c8c8-489f-97e2-e2799dc611d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:17.217033 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7832162-c8c8-489f-97e2-e2799dc611d0 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:17.217821 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7832162-c8c8-489f-97e2-e2799dc611d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:17.218265 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7832162-c8c8-489f-97e2-e2799dc611d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:17.219830 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7832162-c8c8-489f-97e2-e2799dc611d0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:17.237997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 17/34] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:17.239084 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7832162-c8c8-489f-97e2-e2799dc611d0 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:17.291242 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 18/35] 10.222.0.40 () {60 vars in 1131 bytes} [Sat Oct 29 20:30:16 2022] POST /identity/v3/roles => generated 225 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:30:17.292438 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8cce8-9651-4e46-bf84-8807743dee8f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:17.376561 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7832162-c8c8-489f-97e2-e2799dc611d0 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:17.419988 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59aafe-9b03-4d24-bf45-a1de4af09653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:17.420896 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59aafe-9b03-4d24-bf45-a1de4af09653 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:17.421566 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59aafe-9b03-4d24-bf45-a1de4af09653 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:17.421980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59aafe-9b03-4d24-bf45-a1de4af09653 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:17.423403 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59aafe-9b03-4d24-bf45-a1de4af09653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:17.425143 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59aafe-9b03-4d24-bf45-a1de4af09653 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:17.427109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 18/36] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:30:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:17.428219 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8cce8-9651-4e46-bf84-8807743dee8f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:17.432952 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59aafe-9b03-4d24-bf45-a1de4af09653 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:17.465794 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:17.493341 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ba56e-d79f-460d-9fe9-644e18120c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:17.496326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ba56e-d79f-460d-9fe9-644e18120c62 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:17.496871 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ba56e-d79f-460d-9fe9-644e18120c62 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:17.497368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ba56e-d79f-460d-9fe9-644e18120c62 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:17.498244 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ba56e-d79f-460d-9fe9-644e18120c62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:17.504289 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ba56e-d79f-460d-9fe9-644e18120c62 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:17.527511 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:17.574692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 19/37] 10.222.0.40 () {60 vars in 1141 bytes} [Sat Oct 29 20:30:17 2022] POST /identity/v3/projects => generated 301 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:30:17.581777 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80794e-5b49-44f0-86a1-3ffad1e5b585 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:17.582109 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80794e-5b49-44f0-86a1-3ffad1e5b585 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:17.582351 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80794e-5b49-44f0-86a1-3ffad1e5b585 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:17.583900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 20/38] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:17.588631 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219270e-6e93-46fa-8044-a68e7dd1e88b None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:17.588914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219270e-6e93-46fa-8044-a68e7dd1e88b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:17.589250 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219270e-6e93-46fa-8044-a68e7dd1e88b None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:17.590800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 21/39] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:17.591534 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219270e-6e93-46fa-8044-a68e7dd1e88b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:17.623395 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59aafe-9b03-4d24-bf45-a1de4af09653 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:17.672648 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45f344-ba2e-482c-8acf-06c41a9f4754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:17.673862 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45f344-ba2e-482c-8acf-06c41a9f4754 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:17.675539 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45f344-ba2e-482c-8acf-06c41a9f4754 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:17.676000 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45f344-ba2e-482c-8acf-06c41a9f4754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:17.677261 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45f344-ba2e-482c-8acf-06c41a9f4754 None admin] RBAC: Adding query filter params (role.id=9b15e747c88749bfb25139f3bd80b395, scope.domain.id=default, user.id=f9beafc3b84548cf9fb3d264e0f50848) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:17.677572 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45f344-ba2e-482c-8acf-06c41a9f4754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:17.679735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45f344-ba2e-482c-8acf-06c41a9f4754 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:17.691347 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 19/40] 10.222.0.40 () {56 vars in 1322 bytes} [Sat Oct 29 20:30:17 2022] GET /identity/v3/role_assignments?user.id=f9beafc3b84548cf9fb3d264e0f50848&scope.domain.id=default&role.id=9b15e747c88749bfb25139f3bd80b395 => generated 530 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:30:17.693103 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffcb81-8cdc-43da-a318-2745dbd32202 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:17.693414 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffcb81-8cdc-43da-a318-2745dbd32202 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:17.693691 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffcb81-8cdc-43da-a318-2745dbd32202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:17.718765 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-48ffcb81-8cdc-43da-a318-2745dbd32202 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:17.720259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-48ffcb81-8cdc-43da-a318-2745dbd32202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:17.762655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219270e-6e93-46fa-8044-a68e7dd1e88b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:17.818107 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 20/41] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:17.818107 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f773-9383-423f-9df9-83f3a46d0009 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:17.818688 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f773-9383-423f-9df9-83f3a46d0009 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:17.818688 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f773-9383-423f-9df9-83f3a46d0009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:17.826537 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950d419-efaf-444f-ad83-e9f418f0620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:17.829904 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950d419-efaf-444f-ad83-e9f418f0620e None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:17.830184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950d419-efaf-444f-ad83-e9f418f0620e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:17.830468 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950d419-efaf-444f-ad83-e9f418f0620e None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:17.831248 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950d419-efaf-444f-ad83-e9f418f0620e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:17.832758 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950d419-efaf-444f-ad83-e9f418f0620e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:17.851025 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-e851f773-9383-423f-9df9-83f3a46d0009 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:17.852516 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e851f773-9383-423f-9df9-83f3a46d0009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:17.869621 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1131 bytes} [Sat Oct 29 20:30:17 2022] POST /identity/v3/roles => generated 219 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:30:17.895333 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:17.958194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 21/43] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:18.179543 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950d419-efaf-444f-ad83-e9f418f0620e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:18.223373 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:18.280618 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950d419-efaf-444f-ad83-e9f418f0620e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:18.295398 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851f773-9383-423f-9df9-83f3a46d0009 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:18.314703 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bc453-75ed-49f3-83a5-1f16e4e1fea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:18.315926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bc453-75ed-49f3-83a5-1f16e4e1fea6 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:18.316346 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bc453-75ed-49f3-83a5-1f16e4e1fea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:18.316632 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bc453-75ed-49f3-83a5-1f16e4e1fea6 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:18.317309 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bc453-75ed-49f3-83a5-1f16e4e1fea6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:18.318704 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bc453-75ed-49f3-83a5-1f16e4e1fea6 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:18.332981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1131 bytes} [Sat Oct 29 20:30:18 2022] POST /identity/v3/roles => generated 223 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:30:18.405244 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851f773-9383-423f-9df9-83f3a46d0009 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:18.443377 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cb80e-2264-4ff4-b8f3-97ab34ea3bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:18.444007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb80e-2264-4ff4-b8f3-97ab34ea3bdb None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:18.444290 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb80e-2264-4ff4-b8f3-97ab34ea3bdb None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:18.444567 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb80e-2264-4ff4-b8f3-97ab34ea3bdb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:18.445704 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cb80e-2264-4ff4-b8f3-97ab34ea3bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:18.447197 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cb80e-2264-4ff4-b8f3-97ab34ea3bdb None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:18.449130 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 22/45] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:30:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:30:18.454705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bc453-75ed-49f3-83a5-1f16e4e1fea6 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:18.595596 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bc453-75ed-49f3-83a5-1f16e4e1fea6 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:18.598553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:18.633003 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee929079-cfbe-4916-bb98-7c43588f7522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:18.633609 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee929079-cfbe-4916-bb98-7c43588f7522 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:18.633888 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee929079-cfbe-4916-bb98-7c43588f7522 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:18.634152 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee929079-cfbe-4916-bb98-7c43588f7522 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:18.634800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee929079-cfbe-4916-bb98-7c43588f7522 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:18.636269 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee929079-cfbe-4916-bb98-7c43588f7522 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:18.664572 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1141 bytes} [Sat Oct 29 20:30:18 2022] POST /identity/v3/projects => generated 312 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:30:21.049677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9de6c2-c9d0-4247-9f67-7887e12b0cf4 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:21.050199 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9de6c2-c9d0-4247-9f67-7887e12b0cf4 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:21.050285 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9de6c2-c9d0-4247-9f67-7887e12b0cf4 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:21.051620 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 23/47] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:21.056741 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaf0db-e3f0-4ec9-addd-bed0764266e1 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:21.057163 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaf0db-e3f0-4ec9-addd-bed0764266e1 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:21.057296 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaf0db-e3f0-4ec9-addd-bed0764266e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:21.075993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-72eaf0db-e3f0-4ec9-addd-bed0764266e1 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:21.077491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-72eaf0db-e3f0-4ec9-addd-bed0764266e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:21.142873 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 25/48] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:21.465132 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9de6c2-c9d0-4247-9f67-7887e12b0cf4 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:21.496338 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:21.568253 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9de6c2-c9d0-4247-9f67-7887e12b0cf4 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:21.600854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c81fd-ea2d-4828-bced-698757811251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:21.601482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c81fd-ea2d-4828-bced-698757811251 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:21.601760 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c81fd-ea2d-4828-bced-698757811251 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:21.602030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c81fd-ea2d-4828-bced-698757811251 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:21.603131 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c81fd-ea2d-4828-bced-698757811251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:21.604617 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c81fd-ea2d-4828-bced-698757811251 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:21.606170 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 24/49] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:30:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:21.612418 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eaf0db-e3f0-4ec9-addd-bed0764266e1 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:21.694492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:21.710747 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eaf0db-e3f0-4ec9-addd-bed0764266e1 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:21.743560 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a74aeb-771b-447a-ba84-12f248227eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:21.744102 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a74aeb-771b-447a-ba84-12f248227eaf None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:21.744383 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a74aeb-771b-447a-ba84-12f248227eaf None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:21.744659 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a74aeb-771b-447a-ba84-12f248227eaf None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:21.745310 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a74aeb-771b-447a-ba84-12f248227eaf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:21.746765 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a74aeb-771b-447a-ba84-12f248227eaf None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:21.773059 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1140 bytes} [Sat Oct 29 20:30:21 2022] POST /identity/v3/projects => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:30:24.146976 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba34317-75c3-4f71-bb34-9925a9621f9e None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:24.147415 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba34317-75c3-4f71-bb34-9925a9621f9e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:24.147674 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba34317-75c3-4f71-bb34-9925a9621f9e None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:24.148889 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 25/51] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:24.154607 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0838416-1d7f-4670-a18b-8eef4ded111e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:24.155029 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0838416-1d7f-4670-a18b-8eef4ded111e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:24.155166 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0838416-1d7f-4670-a18b-8eef4ded111e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:24.177556 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-d0838416-1d7f-4670-a18b-8eef4ded111e None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:24.178733 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d0838416-1d7f-4670-a18b-8eef4ded111e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:24.245431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 27/52] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:24.561650 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba34317-75c3-4f71-bb34-9925a9621f9e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:24.660056 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:24.664282 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba34317-75c3-4f71-bb34-9925a9621f9e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:24.698610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9444d-c1e7-4d8b-9e68-1d9f91ebd6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:24.699228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9444d-c1e7-4d8b-9e68-1d9f91ebd6fd None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:24.699535 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9444d-c1e7-4d8b-9e68-1d9f91ebd6fd None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:24.699800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9444d-c1e7-4d8b-9e68-1d9f91ebd6fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:24.700881 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9444d-c1e7-4d8b-9e68-1d9f91ebd6fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:24.702309 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9444d-c1e7-4d8b-9e68-1d9f91ebd6fd None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:24.703870 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:30:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:24.709756 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0838416-1d7f-4670-a18b-8eef4ded111e None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:24.778055 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:24.813889 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0838416-1d7f-4670-a18b-8eef4ded111e None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:24.848523 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af7113-7f0f-481d-af4d-fcd546a2003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:24.849123 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af7113-7f0f-481d-af4d-fcd546a2003c None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:24.849399 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af7113-7f0f-481d-af4d-fcd546a2003c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:24.849666 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af7113-7f0f-481d-af4d-fcd546a2003c None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:24.850321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af7113-7f0f-481d-af4d-fcd546a2003c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:24.851808 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af7113-7f0f-481d-af4d-fcd546a2003c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:24.878295 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 28/54] 10.222.0.40 () {60 vars in 1132 bytes} [Sat Oct 29 20:30:24 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:30:28.715902 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354b468-7a14-41cf-b8f8-26609545feb4 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:28.715902 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354b468-7a14-41cf-b8f8-26609545feb4 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:28.715902 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354b468-7a14-41cf-b8f8-26609545feb4 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:28.715902 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 27/55] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:28.721931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea136588-3e2f-4500-afe9-cbc710cbf66e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:28.722342 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea136588-3e2f-4500-afe9-cbc710cbf66e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:28.722534 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea136588-3e2f-4500-afe9-cbc710cbf66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:28.752833 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-ea136588-3e2f-4500-afe9-cbc710cbf66e None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:28.754032 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ea136588-3e2f-4500-afe9-cbc710cbf66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:28.791291 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec128-5b79-4d8f-904c-cd825995a4d0 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:28.791953 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec128-5b79-4d8f-904c-cd825995a4d0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:28.792453 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec128-5b79-4d8f-904c-cd825995a4d0 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:28.793986 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 28/56] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:28.801321 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8615d-7d8f-4d6c-9ad0-30b426c14b09 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:28.801848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8615d-7d8f-4d6c-9ad0-30b426c14b09 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:28.802327 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8615d-7d8f-4d6c-9ad0-30b426c14b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:28.840664 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-4cf8615d-7d8f-4d6c-9ad0-30b426c14b09 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:28.842081 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4cf8615d-7d8f-4d6c-9ad0-30b426c14b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:28.845828 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 29/57] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:28.851888 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96aab1c-ff33-4a5e-b5d8-7ef2e037a9e9 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:28.852360 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96aab1c-ff33-4a5e-b5d8-7ef2e037a9e9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:28.852898 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96aab1c-ff33-4a5e-b5d8-7ef2e037a9e9 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:28.854452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 30/58] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:28.860521 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720834a2-79b7-4f59-97b3-7f8780c672f9 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:28.860968 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720834a2-79b7-4f59-97b3-7f8780c672f9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:28.861439 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720834a2-79b7-4f59-97b3-7f8780c672f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:28.899372 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-720834a2-79b7-4f59-97b3-7f8780c672f9 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:28.912425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-720834a2-79b7-4f59-97b3-7f8780c672f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:28.972238 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 29/59] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:29.027704 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:29.036859 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea106b-bd6d-4675-a517-946008450209 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:29.037144 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea106b-bd6d-4675-a517-946008450209 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:29.039231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea106b-bd6d-4675-a517-946008450209 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:29.039231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 30/60] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:29.047329 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f9151-7da1-4846-9a80-12755caa49ad None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:29.047329 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f9151-7da1-4846-9a80-12755caa49ad None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:29.047329 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f9151-7da1-4846-9a80-12755caa49ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:29.069021 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 31/61] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:30:29.075234 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6a1f9151-7da1-4846-9a80-12755caa49ad None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:29.081526 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6a1f9151-7da1-4846-9a80-12755caa49ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:29.208718 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 31/62] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:29.276944 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720834a2-79b7-4f59-97b3-7f8780c672f9 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:29.411338 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f9151-7da1-4846-9a80-12755caa49ad None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:29.507400 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:29.550039 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720834a2-79b7-4f59-97b3-7f8780c672f9 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:29.625084 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530168bf-1006-4713-9b81-0718be5a16de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:29.625518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530168bf-1006-4713-9b81-0718be5a16de None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:29.625849 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530168bf-1006-4713-9b81-0718be5a16de None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:29.631368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530168bf-1006-4713-9b81-0718be5a16de None admin] PATH_INFO: `/v3/roles/member` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:29.643392 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530168bf-1006-4713-9b81-0718be5a16de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-530168bf-1006-4713-9b81-0718be5a16de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:29.647334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:29.648164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:29.648900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:29.648900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:29.648900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:29.648900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:29.648900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:29.648900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:29.648900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:29.648900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:29.648900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:29.648900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:29.648900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:30:29.648900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:29.648900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 32/63] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:29.648900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530168bf-1006-4713-9b81-0718be5a16de None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:29.655330 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f9151-7da1-4846-9a80-12755caa49ad None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:29.691568 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5605fe8-0a64-40b1-8280-75a23ccfe869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:29.692213 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5605fe8-0a64-40b1-8280-75a23ccfe869 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:29.692495 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5605fe8-0a64-40b1-8280-75a23ccfe869 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:29.692768 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5605fe8-0a64-40b1-8280-75a23ccfe869 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:29.696989 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:29.703532 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5605fe8-0a64-40b1-8280-75a23ccfe869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-f5605fe8-0a64-40b1-8280-75a23ccfe869 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:29.708997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:29.709812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:29.710640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:29.710640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:29.710640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:29.710640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:29.710640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:29.710640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:29.710640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:29.710640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:29.710640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:29.710640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:29.710640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:30:29.710640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:30:29.710640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 32/64] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:30:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:29.711253 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5605fe8-0a64-40b1-8280-75a23ccfe869 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:29.764996 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530168bf-1006-4713-9b81-0718be5a16de None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:29.802181 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154a3bf-9d8f-41ba-84ca-9a69cec5c0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:29.802805 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154a3bf-9d8f-41ba-84ca-9a69cec5c0f8 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:29.803089 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154a3bf-9d8f-41ba-84ca-9a69cec5c0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:29.803394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154a3bf-9d8f-41ba-84ca-9a69cec5c0f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:29.806377 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:29.814027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154a3bf-9d8f-41ba-84ca-9a69cec5c0f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-0154a3bf-9d8f-41ba-84ca-9a69cec5c0f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:29.819405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:29.820223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:29.820974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:29.820974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:29.820974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:29.820974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:29.820974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:29.820974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:29.820974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:29.820974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:29.820974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:29.820974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:29.820974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:30:29.820974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:29.820974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 33/65] 10.222.0.40 () {56 vars in 1096 bytes} [Sat Oct 29 20:30:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:29.821579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154a3bf-9d8f-41ba-84ca-9a69cec5c0f8 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:29.822931 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5605fe8-0a64-40b1-8280-75a23ccfe869 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:29.864925 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc48ad2-6183-41f1-86d7-475ec0348374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:29.865562 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc48ad2-6183-41f1-86d7-475ec0348374 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:29.865842 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc48ad2-6183-41f1-86d7-475ec0348374 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:29.866115 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc48ad2-6183-41f1-86d7-475ec0348374 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:29.879926 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc48ad2-6183-41f1-86d7-475ec0348374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-7dc48ad2-6183-41f1-86d7-475ec0348374 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:29.884886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:29.885735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:29.886463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:29.886463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:29.886463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:29.886463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:29.886463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:29.886463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:29.886463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:29.886463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:29.886463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:29.886463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:29.886463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:30:29.886463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:30:29.886463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 33/66] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:29.887144 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab7df2-b303-4bda-867e-c0d1fe2007f6 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:29.887453 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab7df2-b303-4bda-867e-c0d1fe2007f6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:29.887728 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab7df2-b303-4bda-867e-c0d1fe2007f6 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:29.889077 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 34/67] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:29.889771 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab7df2-b303-4bda-867e-c0d1fe2007f6 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:29.951241 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154a3bf-9d8f-41ba-84ca-9a69cec5c0f8 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:29.953003 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:29.991191 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a05ce-ca0d-40d5-9e2d-4fb16d8ba634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:29.991861 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a05ce-ca0d-40d5-9e2d-4fb16d8ba634 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:29.992143 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a05ce-ca0d-40d5-9e2d-4fb16d8ba634 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:29.992421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a05ce-ca0d-40d5-9e2d-4fb16d8ba634 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:29.993081 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a05ce-ca0d-40d5-9e2d-4fb16d8ba634 None admin] RBAC: Adding query filter params (name=member) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:29.993383 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a05ce-ca0d-40d5-9e2d-4fb16d8ba634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:29.994789 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a05ce-ca0d-40d5-9e2d-4fb16d8ba634 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:30.001360 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab7df2-b303-4bda-867e-c0d1fe2007f6 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:30.003757 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 34/68] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:30:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:30.008473 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a05ce-ca0d-40d5-9e2d-4fb16d8ba634 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:30.037787 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b297dd-ebf9-4f18-8049-65143fd2c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:30.038323 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b297dd-ebf9-4f18-8049-65143fd2c01a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:30.038615 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b297dd-ebf9-4f18-8049-65143fd2c01a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:30.038866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b297dd-ebf9-4f18-8049-65143fd2c01a None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:30.039552 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b297dd-ebf9-4f18-8049-65143fd2c01a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:30.039852 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b297dd-ebf9-4f18-8049-65143fd2c01a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:30.041237 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b297dd-ebf9-4f18-8049-65143fd2c01a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:30.052559 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 35/69] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:30:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:30.053476 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b297dd-ebf9-4f18-8049-65143fd2c01a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:30.066493 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:30.121791 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a05ce-ca0d-40d5-9e2d-4fb16d8ba634 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:30.161072 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b297dd-ebf9-4f18-8049-65143fd2c01a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:30.166419 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01192f-6473-4ffc-8a9f-f033e7d18863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:30.167018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01192f-6473-4ffc-8a9f-f033e7d18863 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:30.167293 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01192f-6473-4ffc-8a9f-f033e7d18863 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:30.167588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01192f-6473-4ffc-8a9f-f033e7d18863 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:30.168250 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01192f-6473-4ffc-8a9f-f033e7d18863 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:30.168549 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01192f-6473-4ffc-8a9f-f033e7d18863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:30.169916 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01192f-6473-4ffc-8a9f-f033e7d18863 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:30.182091 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 35/70] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:30.183520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040e31e-ee33-4f25-8979-878794cc4f84 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:30.184080 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040e31e-ee33-4f25-8979-878794cc4f84 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:30.184375 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040e31e-ee33-4f25-8979-878794cc4f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:30.201727 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc072af9-b315-41ac-a48f-90dfbb7fa1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:30.202583 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072af9-b315-41ac-a48f-90dfbb7fa1bc None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:30.202890 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9040e31e-ee33-4f25-8979-878794cc4f84 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:30.203259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072af9-b315-41ac-a48f-90dfbb7fa1bc None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:30.203791 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072af9-b315-41ac-a48f-90dfbb7fa1bc None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:30.204083 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9040e31e-ee33-4f25-8979-878794cc4f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:30.204753 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc072af9-b315-41ac-a48f-90dfbb7fa1bc None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:30.205123 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc072af9-b315-41ac-a48f-90dfbb7fa1bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:30.206735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc072af9-b315-41ac-a48f-90dfbb7fa1bc None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:30.215177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 36/71] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:30:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:30.216014 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc072af9-b315-41ac-a48f-90dfbb7fa1bc None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:30.236069 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:30.294292 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 36/72] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:30.299638 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:30.300218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040e31e-ee33-4f25-8979-878794cc4f84 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:30.352423 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc072af9-b315-41ac-a48f-90dfbb7fa1bc None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:30.404847 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1a48b-8975-4c6b-8a25-c90bc354f608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:30.405764 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1a48b-8975-4c6b-8a25-c90bc354f608 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:30.406189 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1a48b-8975-4c6b-8a25-c90bc354f608 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:30.406701 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1a48b-8975-4c6b-8a25-c90bc354f608 None admin] PATH_INFO: `/v3/users/3ffe1b6ef2a747b697f39f0d31ecd7db` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:30.432123 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1a48b-8975-4c6b-8a25-c90bc354f608 None admin] RBAC: Authorizing `identity:get_user(user_id=3ffe1b6ef2a747b697f39f0d31ecd7db)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:30.433531 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1a48b-8975-4c6b-8a25-c90bc354f608 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:30.440075 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 37/73] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:30 2022] GET /identity/v3/users/3ffe1b6ef2a747b697f39f0d31ecd7db => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:30.440075 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1a48b-8975-4c6b-8a25-c90bc354f608 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:30.449212 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040e31e-ee33-4f25-8979-878794cc4f84 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:30.498495 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b55cd-7dde-4398-9009-22bf1c9efcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:30.499131 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b55cd-7dde-4398-9009-22bf1c9efcaf None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:30.499454 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b55cd-7dde-4398-9009-22bf1c9efcaf None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:30.499715 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b55cd-7dde-4398-9009-22bf1c9efcaf None admin] PATH_INFO: `/v3/users/3ffe1b6ef2a747b697f39f0d31ecd7db` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:30.500855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b55cd-7dde-4398-9009-22bf1c9efcaf None admin] RBAC: Authorizing `identity:get_user(user_id=3ffe1b6ef2a747b697f39f0d31ecd7db)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:30.502352 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b55cd-7dde-4398-9009-22bf1c9efcaf None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:30.504114 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 37/74] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:30 2022] GET /identity/v3/users/3ffe1b6ef2a747b697f39f0d31ecd7db => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:30.509084 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b55cd-7dde-4398-9009-22bf1c9efcaf None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:30.541268 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:30.606539 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1a48b-8975-4c6b-8a25-c90bc354f608 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:30.640629 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:30.647371 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c2645-1c99-43d1-947e-26cde91a39af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:30.648169 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c2645-1c99-43d1-947e-26cde91a39af None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:30.648621 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c2645-1c99-43d1-947e-26cde91a39af None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:30.648898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c2645-1c99-43d1-947e-26cde91a39af None admin] PATH_INFO: `/v3/users/f9beafc3b84548cf9fb3d264e0f50848` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:30.650074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c2645-1c99-43d1-947e-26cde91a39af None admin] RBAC: Authorizing `identity:get_user(user_id=f9beafc3b84548cf9fb3d264e0f50848)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:30.651593 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c2645-1c99-43d1-947e-26cde91a39af None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:30.653179 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 38/75] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:30 2022] GET /identity/v3/users/f9beafc3b84548cf9fb3d264e0f50848 => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:30.653179 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c2645-1c99-43d1-947e-26cde91a39af None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:30.655542 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b55cd-7dde-4398-9009-22bf1c9efcaf None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:30.705334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21be68-9cc2-406d-9196-5e0338fb152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:30.705979 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21be68-9cc2-406d-9196-5e0338fb152e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:30.706229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21be68-9cc2-406d-9196-5e0338fb152e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:30.706609 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21be68-9cc2-406d-9196-5e0338fb152e None admin] PATH_INFO: `/v3/users/3ffe1b6ef2a747b697f39f0d31ecd7db` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:30.707877 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21be68-9cc2-406d-9196-5e0338fb152e None admin] RBAC: Authorizing `identity:get_user(user_id=3ffe1b6ef2a747b697f39f0d31ecd7db)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:30.709321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21be68-9cc2-406d-9196-5e0338fb152e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:30.711023 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 38/76] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:30 2022] GET /identity/v3/users/3ffe1b6ef2a747b697f39f0d31ecd7db => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:30.711807 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21be68-9cc2-406d-9196-5e0338fb152e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:30.763810 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c2645-1c99-43d1-947e-26cde91a39af None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:30.806254 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e77b83-5d48-459c-afbc-a1af5bd0d8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:30.806893 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e77b83-5d48-459c-afbc-a1af5bd0d8d7 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:30.807463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e77b83-5d48-459c-afbc-a1af5bd0d8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:30.807533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e77b83-5d48-459c-afbc-a1af5bd0d8d7 None admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:30.808674 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e77b83-5d48-459c-afbc-a1af5bd0d8d7 None admin] RBAC: Authorizing `identity:get_project(project_id=6c41b3079f3f49db85d760bd5ef1f568)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:30.810139 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e77b83-5d48-459c-afbc-a1af5bd0d8d7 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:30.816975 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 39/77] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:30 2022] GET /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:30.816975 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e77b83-5d48-459c-afbc-a1af5bd0d8d7 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:30.817185 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:30.826827 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21be68-9cc2-406d-9196-5e0338fb152e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:30.865498 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf68737-c713-467d-a24f-f5ea2e55609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:30.866178 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf68737-c713-467d-a24f-f5ea2e55609a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:30.866519 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf68737-c713-467d-a24f-f5ea2e55609a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:30.866792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf68737-c713-467d-a24f-f5ea2e55609a None admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:30.867941 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf68737-c713-467d-a24f-f5ea2e55609a None admin] RBAC: Authorizing `identity:get_project(project_id=6c41b3079f3f49db85d760bd5ef1f568)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:30.869373 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf68737-c713-467d-a24f-f5ea2e55609a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:30.871034 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 39/78] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:30 2022] GET /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:30.871830 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf68737-c713-467d-a24f-f5ea2e55609a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:30.891112 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:30.931973 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e77b83-5d48-459c-afbc-a1af5bd0d8d7 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:30.968784 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9676f8d-2362-4471-9871-ca8c3139c017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:30.969420 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9676f8d-2362-4471-9871-ca8c3139c017 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:30.969682 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9676f8d-2362-4471-9871-ca8c3139c017 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:30.969951 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9676f8d-2362-4471-9871-ca8c3139c017 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:30.971083 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9676f8d-2362-4471-9871-ca8c3139c017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:30.972568 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9676f8d-2362-4471-9871-ca8c3139c017 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:30.974101 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 40/79] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:30:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:30.974851 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9676f8d-2362-4471-9871-ca8c3139c017 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:30.992820 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf68737-c713-467d-a24f-f5ea2e55609a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:31.034501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b8b0a-01e2-4c2b-a44b-f02778a09551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:31.035138 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b8b0a-01e2-4c2b-a44b-f02778a09551 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:31.035454 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b8b0a-01e2-4c2b-a44b-f02778a09551 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:31.035732 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b8b0a-01e2-4c2b-a44b-f02778a09551 None admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:31.036865 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b8b0a-01e2-4c2b-a44b-f02778a09551 None admin] RBAC: Authorizing `identity:get_project(project_id=6c41b3079f3f49db85d760bd5ef1f568)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:31.038309 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b8b0a-01e2-4c2b-a44b-f02778a09551 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:31.039980 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 40/80] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:30 2022] GET /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:31.040717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b8b0a-01e2-4c2b-a44b-f02778a09551 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:31.068541 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:31.095007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9676f8d-2362-4471-9871-ca8c3139c017 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:31.130919 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1dc47-a78d-4701-9bae-1a3fbf93cc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:31.131507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1dc47-a78d-4701-9bae-1a3fbf93cc84 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:31.131834 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1dc47-a78d-4701-9bae-1a3fbf93cc84 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:31.132112 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1dc47-a78d-4701-9bae-1a3fbf93cc84 None admin] PATH_INFO: `/v3/projects/36b83d7cbe174bacb44a8af64e37087b` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:31.133248 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1dc47-a78d-4701-9bae-1a3fbf93cc84 None admin] RBAC: Authorizing `identity:get_project(project_id=36b83d7cbe174bacb44a8af64e37087b)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:31.134714 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1dc47-a78d-4701-9bae-1a3fbf93cc84 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:31.136373 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 41/81] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:30 2022] GET /identity/v3/projects/36b83d7cbe174bacb44a8af64e37087b => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:31.137110 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1dc47-a78d-4701-9bae-1a3fbf93cc84 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:31.139758 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:31.145785 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b8b0a-01e2-4c2b-a44b-f02778a09551 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:31.179942 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b037128-54ce-41ff-af21-b46a6152aff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:31.180596 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b037128-54ce-41ff-af21-b46a6152aff7 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:31.180872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b037128-54ce-41ff-af21-b46a6152aff7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:31.181140 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b037128-54ce-41ff-af21-b46a6152aff7 None admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568/users/3ffe1b6ef2a747b697f39f0d31ecd7db/roles/b2dae64b76124d298b982ee42347b223` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:31.183061 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b037128-54ce-41ff-af21-b46a6152aff7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c41b3079f3f49db85d760bd5ef1f568, user_id=3ffe1b6ef2a747b697f39f0d31ecd7db, role_id=b2dae64b76124d298b982ee42347b223)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:31.184556 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b037128-54ce-41ff-af21-b46a6152aff7 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:31.198712 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 41/82] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:30:31 2022] PUT /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568/users/3ffe1b6ef2a747b697f39f0d31ecd7db/roles/b2dae64b76124d298b982ee42347b223 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:30:31.199512 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b037128-54ce-41ff-af21-b46a6152aff7 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:31.251566 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1dc47-a78d-4701-9bae-1a3fbf93cc84 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:31.294688 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c94cc-f40d-4a21-8c4e-d03d0b9303bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:31.295575 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c94cc-f40d-4a21-8c4e-d03d0b9303bc None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:31.295858 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c94cc-f40d-4a21-8c4e-d03d0b9303bc None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:31.296385 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c94cc-f40d-4a21-8c4e-d03d0b9303bc None admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568/users/3ffe1b6ef2a747b697f39f0d31ecd7db/roles/d6c014b407594f248f451d331253c8a6` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:31.299006 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c94cc-f40d-4a21-8c4e-d03d0b9303bc None admin] RBAC: Authorizing `identity:create_grant(project_id=6c41b3079f3f49db85d760bd5ef1f568, user_id=3ffe1b6ef2a747b697f39f0d31ecd7db, role_id=d6c014b407594f248f451d331253c8a6)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:31.300927 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c94cc-f40d-4a21-8c4e-d03d0b9303bc None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:31.318080 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 42/83] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:30:31 2022] PUT /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568/users/3ffe1b6ef2a747b697f39f0d31ecd7db/roles/d6c014b407594f248f451d331253c8a6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:30:31.319065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c94cc-f40d-4a21-8c4e-d03d0b9303bc None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:31.341157 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:31.361532 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b037128-54ce-41ff-af21-b46a6152aff7 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:31.417538 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:31.419042 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34780b13-6cea-4e2e-a4e2-aefadfb8d05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:31.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34780b13-6cea-4e2e-a4e2-aefadfb8d05f None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:31.420411 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34780b13-6cea-4e2e-a4e2-aefadfb8d05f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:31.420411 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34780b13-6cea-4e2e-a4e2-aefadfb8d05f None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:31.420865 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34780b13-6cea-4e2e-a4e2-aefadfb8d05f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:31.423827 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34780b13-6cea-4e2e-a4e2-aefadfb8d05f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:31.455710 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 42/84] 10.222.0.40 () {60 vars in 1132 bytes} [Sat Oct 29 20:30:31 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:30:31.455710 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34780b13-6cea-4e2e-a4e2-aefadfb8d05f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:31.489664 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c94cc-f40d-4a21-8c4e-d03d0b9303bc None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:31.545160 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb403f56-fab7-45ca-b359-5842324e9ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:31.548043 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb403f56-fab7-45ca-b359-5842324e9ed0 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:31.550858 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb403f56-fab7-45ca-b359-5842324e9ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:31.550858 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb403f56-fab7-45ca-b359-5842324e9ed0 None admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568/users/f9beafc3b84548cf9fb3d264e0f50848/roles/9b15e747c88749bfb25139f3bd80b395` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:31.555333 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb403f56-fab7-45ca-b359-5842324e9ed0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c41b3079f3f49db85d760bd5ef1f568, user_id=f9beafc3b84548cf9fb3d264e0f50848, role_id=9b15e747c88749bfb25139f3bd80b395)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:31.556909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb403f56-fab7-45ca-b359-5842324e9ed0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:31.589152 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 43/85] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:30:31 2022] PUT /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568/users/f9beafc3b84548cf9fb3d264e0f50848/roles/9b15e747c88749bfb25139f3bd80b395 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:30:31.640627 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34780b13-6cea-4e2e-a4e2-aefadfb8d05f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:31.689035 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2a125-8d92-405c-a67c-4398d3ff48f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:31.689635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2a125-8d92-405c-a67c-4398d3ff48f6 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:31.690535 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2a125-8d92-405c-a67c-4398d3ff48f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:31.690814 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2a125-8d92-405c-a67c-4398d3ff48f6 None admin] PATH_INFO: `/v3/projects/36b83d7cbe174bacb44a8af64e37087b/users/3ffe1b6ef2a747b697f39f0d31ecd7db/roles/b2dae64b76124d298b982ee42347b223` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:31.693147 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2a125-8d92-405c-a67c-4398d3ff48f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=36b83d7cbe174bacb44a8af64e37087b, user_id=3ffe1b6ef2a747b697f39f0d31ecd7db, role_id=b2dae64b76124d298b982ee42347b223)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:31.694687 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2a125-8d92-405c-a67c-4398d3ff48f6 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:31.711069 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 43/86] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:30:31 2022] PUT /identity/v3/projects/36b83d7cbe174bacb44a8af64e37087b/users/3ffe1b6ef2a747b697f39f0d31ecd7db/roles/b2dae64b76124d298b982ee42347b223 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:30:34.882782 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09471fd0-bf9a-450d-a1d9-8f7686b1fec2 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:34.883293 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09471fd0-bf9a-450d-a1d9-8f7686b1fec2 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:34.883440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09471fd0-bf9a-450d-a1d9-8f7686b1fec2 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:34.884862 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 44/87] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:34.891109 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0e175-30d0-4afc-88e0-1817c7903fd3 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:34.891564 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0e175-30d0-4afc-88e0-1817c7903fd3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:34.891733 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0e175-30d0-4afc-88e0-1817c7903fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:34.906287 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:34.924795 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-94f0e175-30d0-4afc-88e0-1817c7903fd3 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:34.926006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-94f0e175-30d0-4afc-88e0-1817c7903fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:34.937632 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b56615-9990-4b82-9ff0-580ab274a506 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:34.937632 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b56615-9990-4b82-9ff0-580ab274a506 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:34.937632 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b56615-9990-4b82-9ff0-580ab274a506 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:34.939067 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 45/88] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:30:34.945423 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da611f73-5b53-4b16-8d45-45c51f35e360 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:34.945949 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da611f73-5b53-4b16-8d45-45c51f35e360 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:34.946418 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da611f73-5b53-4b16-8d45-45c51f35e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:34.989105 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-da611f73-5b53-4b16-8d45-45c51f35e360 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:34.990307 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-da611f73-5b53-4b16-8d45-45c51f35e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:35.038761 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 44/89] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:35.121994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 46/90] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:30:35.131329 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed4246-102b-4f8e-8d37-a5d14c3a6bae None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:35.131329 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed4246-102b-4f8e-8d37-a5d14c3a6bae None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:35.131329 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed4246-102b-4f8e-8d37-a5d14c3a6bae None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:35.131329 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 45/91] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:35.136643 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18573a7b-4d48-453e-bc31-215b612fff5e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:35.136854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18573a7b-4d48-453e-bc31-215b612fff5e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:35.137131 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18573a7b-4d48-453e-bc31-215b612fff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:35.169229 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-18573a7b-4d48-453e-bc31-215b612fff5e None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:35.170401 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-18573a7b-4d48-453e-bc31-215b612fff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:35.244433 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:35.281986 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 47/92] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:35.376018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376e798-5fac-4f87-bce0-cccfa8e798c6 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:35.376323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376e798-5fac-4f87-bce0-cccfa8e798c6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:35.376569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376e798-5fac-4f87-bce0-cccfa8e798c6 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:35.379498 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 46/93] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:35.385201 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fb653-4ef4-4417-9732-a442cd24d3d5 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:35.385493 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fb653-4ef4-4417-9732-a442cd24d3d5 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:35.385763 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fb653-4ef4-4417-9732-a442cd24d3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:35.417486 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-552fb653-4ef4-4417-9732-a442cd24d3d5 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:35.418924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-552fb653-4ef4-4417-9732-a442cd24d3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:35.537715 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 48/94] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:35.561779 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376e798-5fac-4f87-bce0-cccfa8e798c6 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:35.586197 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fb653-4ef4-4417-9732-a442cd24d3d5 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:35.801216 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fb653-4ef4-4417-9732-a442cd24d3d5 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:35.828910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:35.829164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376e798-5fac-4f87-bce0-cccfa8e798c6 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:35.874128 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b98f4d-6413-4512-aa79-eab6b72e7e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:35.875058 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b98f4d-6413-4512-aa79-eab6b72e7e13 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:35.875513 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b98f4d-6413-4512-aa79-eab6b72e7e13 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:35.875945 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b98f4d-6413-4512-aa79-eab6b72e7e13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:35.899481 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b98f4d-6413-4512-aa79-eab6b72e7e13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-b0b98f4d-6413-4512-aa79-eab6b72e7e13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:35.905507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:35.906439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:35.907218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:35.907218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:35.907218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:35.907218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:35.907218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:35.907218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:35.907218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:35.907218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:35.907218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:35.907218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:35.907218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:30:35.907218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:30:35.909864 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 49/95] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:30:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:30:35.911532 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dece2-85f1-4cf9-8521-0af5f78d2ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:35.912694 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dece2-85f1-4cf9-8521-0af5f78d2ad1 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:35.913143 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dece2-85f1-4cf9-8521-0af5f78d2ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:35.913619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dece2-85f1-4cf9-8521-0af5f78d2ad1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:35.920097 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b98f4d-6413-4512-aa79-eab6b72e7e13 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:35.922591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:35.931724 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8dece2-85f1-4cf9-8521-0af5f78d2ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-0c8dece2-85f1-4cf9-8521-0af5f78d2ad1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:35.936993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:35.937876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:35.938641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:35.938641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:35.938641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:35.938641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:35.938641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:35.938641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:35.938641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:35.938641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:35.938641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:35.938641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:35.938641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:30:35.938641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:35.941729 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 47/96] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:35.942739 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dece2-85f1-4cf9-8521-0af5f78d2ad1 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:36.031526 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b98f4d-6413-4512-aa79-eab6b72e7e13 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:36.046708 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dece2-85f1-4cf9-8521-0af5f78d2ad1 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:36.065249 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40c439-f2e1-4426-be0d-83ac7df23790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:36.065900 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40c439-f2e1-4426-be0d-83ac7df23790 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.066181 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40c439-f2e1-4426-be0d-83ac7df23790 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.066452 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40c439-f2e1-4426-be0d-83ac7df23790 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.076601 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40c439-f2e1-4426-be0d-83ac7df23790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:36.081695 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7d3b9-9f55-47aa-b192-a54522b33785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-4f40c439-f2e1-4426-be0d-83ac7df23790 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:36.082194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:36.083154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:36.084180 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:36.084180 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:36.084180 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:36.084180 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:36.084180 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:36.084180 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:36.084180 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:36.084180 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:36.084180 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:36.084180 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:36.084180 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:30:36.084180 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:30:36.085004 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d3b9-9f55-47aa-b192-a54522b33785 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.085004 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d3b9-9f55-47aa-b192-a54522b33785 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.085004 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d3b9-9f55-47aa-b192-a54522b33785 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.085004 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7d3b9-9f55-47aa-b192-a54522b33785 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:36.085335 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 50/97] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:36.085405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7d3b9-9f55-47aa-b192-a54522b33785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:36.085475 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35798-a66f-40f9-af81-a63769ff5793 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.085475 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35798-a66f-40f9-af81-a63769ff5793 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.085600 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7d3b9-9f55-47aa-b192-a54522b33785 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:36.085668 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35798-a66f-40f9-af81-a63769ff5793 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.086496 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 51/98] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:36.087526 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb37221-fec4-4cfc-a439-1998abb01053 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.087809 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb37221-fec4-4cfc-a439-1998abb01053 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.088088 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb37221-fec4-4cfc-a439-1998abb01053 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.089759 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 52/99] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:36.090459 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb37221-fec4-4cfc-a439-1998abb01053 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:36.103842 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 48/100] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:30:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:36.103842 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7d3b9-9f55-47aa-b192-a54522b33785 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:36.124974 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:36.157896 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:36.198165 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb37221-fec4-4cfc-a439-1998abb01053 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:36.202129 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7d3b9-9f55-47aa-b192-a54522b33785 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:36.235646 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3740e4d-16db-49db-ad2a-1f59c7c1b5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:36.236061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbcea7-fa48-498a-b67a-4b291231e9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:36.236297 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3740e4d-16db-49db-ad2a-1f59c7c1b5f5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.237212 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3740e4d-16db-49db-ad2a-1f59c7c1b5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.237373 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbcea7-fa48-498a-b67a-4b291231e9ae None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.237488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3740e4d-16db-49db-ad2a-1f59c7c1b5f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.237589 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbcea7-fa48-498a-b67a-4b291231e9ae None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.237931 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbcea7-fa48-498a-b67a-4b291231e9ae None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.238645 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbcea7-fa48-498a-b67a-4b291231e9ae None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:36.238960 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbcea7-fa48-498a-b67a-4b291231e9ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:36.240488 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbcea7-fa48-498a-b67a-4b291231e9ae None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:36.247796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3740e4d-16db-49db-ad2a-1f59c7c1b5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:36.249207 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 53/101] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:30:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:36.250017 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbcea7-fa48-498a-b67a-4b291231e9ae None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-c3740e4d-16db-49db-ad2a-1f59c7c1b5f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:36.256619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:36.257487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:36.258638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:36.258638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:36.258638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:36.258638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:36.258638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:36.258638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:36.258638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:36.258638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:36.258638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:36.258638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:36.258638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 20:30:36.258638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:36.258638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 49/102] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:36.259537 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bc15-226e-4892-a60d-070152eca269 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.259537 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bc15-226e-4892-a60d-070152eca269 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.259834 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bc15-226e-4892-a60d-070152eca269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.279528 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-ab87bc15-226e-4892-a60d-070152eca269 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:36.280749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ab87bc15-226e-4892-a60d-070152eca269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:36.348337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:36.350294 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 50/103] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:36.351757 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b4bba-348d-499a-a964-0258f5dbef98 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.352043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b4bba-348d-499a-a964-0258f5dbef98 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.352321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b4bba-348d-499a-a964-0258f5dbef98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.361008 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbcea7-fa48-498a-b67a-4b291231e9ae None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:36.371226 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-107b4bba-348d-499a-a964-0258f5dbef98 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:36.372437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-107b4bba-348d-499a-a964-0258f5dbef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:36.398235 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c49668-c3e8-487e-83bf-b5bd9b93b0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:36.398965 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c49668-c3e8-487e-83bf-b5bd9b93b0f1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.399327 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c49668-c3e8-487e-83bf-b5bd9b93b0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.399613 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c49668-c3e8-487e-83bf-b5bd9b93b0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.400394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c49668-c3e8-487e-83bf-b5bd9b93b0f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:36.400741 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c49668-c3e8-487e-83bf-b5bd9b93b0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:36.402300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c49668-c3e8-487e-83bf-b5bd9b93b0f1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:36.411279 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 54/104] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:30:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:36.412057 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c49668-c3e8-487e-83bf-b5bd9b93b0f1 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:36.424684 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:36.459006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 51/105] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:36.468716 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b4bba-348d-499a-a964-0258f5dbef98 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:36.534986 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c49668-c3e8-487e-83bf-b5bd9b93b0f1 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:36.583202 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6de91a-8c5b-41a0-a205-c09098d185b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:36.583891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6de91a-8c5b-41a0-a205-c09098d185b5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.584173 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6de91a-8c5b-41a0-a205-c09098d185b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.584449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6de91a-8c5b-41a0-a205-c09098d185b5 None admin] PATH_INFO: `/v3/users/3ffe1b6ef2a747b697f39f0d31ecd7db` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.585591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6de91a-8c5b-41a0-a205-c09098d185b5 None admin] RBAC: Authorizing `identity:get_user(user_id=3ffe1b6ef2a747b697f39f0d31ecd7db)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:36.587169 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6de91a-8c5b-41a0-a205-c09098d185b5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:36.589010 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 55/106] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:36 2022] GET /identity/v3/users/3ffe1b6ef2a747b697f39f0d31ecd7db => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:36.589604 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6de91a-8c5b-41a0-a205-c09098d185b5 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:36.595589 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b4bba-348d-499a-a964-0258f5dbef98 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:36.617976 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:36.645910 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fa0d9-8bdc-4179-ac3d-e61e8fe490c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:36.647262 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fa0d9-8bdc-4179-ac3d-e61e8fe490c9 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.647765 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fa0d9-8bdc-4179-ac3d-e61e8fe490c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.648256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fa0d9-8bdc-4179-ac3d-e61e8fe490c9 None admin] PATH_INFO: `/v3/users/3ffe1b6ef2a747b697f39f0d31ecd7db` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.650119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fa0d9-8bdc-4179-ac3d-e61e8fe490c9 None admin] RBAC: Authorizing `identity:get_user(user_id=3ffe1b6ef2a747b697f39f0d31ecd7db)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:36.653105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fa0d9-8bdc-4179-ac3d-e61e8fe490c9 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:36.655618 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 52/107] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:36 2022] GET /identity/v3/users/3ffe1b6ef2a747b697f39f0d31ecd7db => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:36.656593 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fa0d9-8bdc-4179-ac3d-e61e8fe490c9 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:36.705370 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6de91a-8c5b-41a0-a205-c09098d185b5 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:36.718823 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:36.742459 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ec854-2636-4999-903a-7f1ca5583522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:36.743315 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ec854-2636-4999-903a-7f1ca5583522 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.743610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ec854-2636-4999-903a-7f1ca5583522 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.743892 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ec854-2636-4999-903a-7f1ca5583522 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.744554 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ec854-2636-4999-903a-7f1ca5583522 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:36.744859 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ec854-2636-4999-903a-7f1ca5583522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:36.746222 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ec854-2636-4999-903a-7f1ca5583522 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:36.754739 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 56/108] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:30:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:36.755495 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ec854-2636-4999-903a-7f1ca5583522 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:36.782584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fa0d9-8bdc-4179-ac3d-e61e8fe490c9 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:36.819113 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1517dba-2a91-4fb7-96ae-d0e0ca4a732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:36.819776 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517dba-2a91-4fb7-96ae-d0e0ca4a732d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.820059 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517dba-2a91-4fb7-96ae-d0e0ca4a732d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.820334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517dba-2a91-4fb7-96ae-d0e0ca4a732d None admin] PATH_INFO: `/v3/users/3ffe1b6ef2a747b697f39f0d31ecd7db` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.821467 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1517dba-2a91-4fb7-96ae-d0e0ca4a732d None admin] RBAC: Authorizing `identity:get_user(user_id=3ffe1b6ef2a747b697f39f0d31ecd7db)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:36.822920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1517dba-2a91-4fb7-96ae-d0e0ca4a732d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:36.824517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 53/109] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:36 2022] GET /identity/v3/users/3ffe1b6ef2a747b697f39f0d31ecd7db => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:36.825277 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1517dba-2a91-4fb7-96ae-d0e0ca4a732d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:36.851981 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:36.871432 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ec854-2636-4999-903a-7f1ca5583522 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:36.906799 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ef587-e6b6-4f5d-bd69-6c50895f8e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:36.907448 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ef587-e6b6-4f5d-bd69-6c50895f8e7b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.907708 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ef587-e6b6-4f5d-bd69-6c50895f8e7b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.907979 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ef587-e6b6-4f5d-bd69-6c50895f8e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.927138 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1517dba-2a91-4fb7-96ae-d0e0ca4a732d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:36.940701 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:36.961868 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2275ce8-5628-4c28-98f0-e6a07bf6de57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:36.962470 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2275ce8-5628-4c28-98f0-e6a07bf6de57 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:36.962745 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2275ce8-5628-4c28-98f0-e6a07bf6de57 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:36.963013 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2275ce8-5628-4c28-98f0-e6a07bf6de57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:36.975481 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ef587-e6b6-4f5d-bd69-6c50895f8e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:36.977006 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ef587-e6b6-4f5d-bd69-6c50895f8e7b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:37.031507 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2275ce8-5628-4c28-98f0-e6a07bf6de57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:37.033014 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2275ce8-5628-4c28-98f0-e6a07bf6de57 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:37.060408 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:37.077117 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 57/110] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:30:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:30:37.077977 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ef587-e6b6-4f5d-bd69-6c50895f8e7b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:37.136329 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 54/111] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:30:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:30:37.137009 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2275ce8-5628-4c28-98f0-e6a07bf6de57 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:37.153131 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:37.179199 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ef587-e6b6-4f5d-bd69-6c50895f8e7b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:37.214930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4762ed-fddb-4600-b277-bffd7dc05f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:37.215633 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4762ed-fddb-4600-b277-bffd7dc05f22 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:37.215877 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4762ed-fddb-4600-b277-bffd7dc05f22 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:37.216142 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4762ed-fddb-4600-b277-bffd7dc05f22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:37.227398 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4762ed-fddb-4600-b277-bffd7dc05f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-2e4762ed-fddb-4600-b277-bffd7dc05f22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:37.232482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:37.233387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:37.234228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:37.234228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:37.234228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:37.234228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:37.234228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:37.234228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:37.234228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:37.234228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:37.234228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:37.234228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:37.234228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:30:37.234228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:30:37.234228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 58/112] 10.222.0.40 () {56 vars in 1096 bytes} [Sat Oct 29 20:30:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:37.234844 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4762ed-fddb-4600-b277-bffd7dc05f22 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:37.246254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2275ce8-5628-4c28-98f0-e6a07bf6de57 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:37.282624 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8524c-05b7-467f-949c-412382b7a5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:37.283325 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8524c-05b7-467f-949c-412382b7a5b2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:37.283958 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:37.284185 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8524c-05b7-467f-949c-412382b7a5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:37.284554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8524c-05b7-467f-949c-412382b7a5b2 None admin] PATH_INFO: `/v3/users/e270a2e1b62f4de39a05005623eac58e` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:37.300369 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8524c-05b7-467f-949c-412382b7a5b2 None admin] RBAC: Authorizing `identity:get_user(user_id=e270a2e1b62f4de39a05005623eac58e)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:37.301839 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8524c-05b7-467f-949c-412382b7a5b2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:37.303521 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 55/113] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:37 2022] GET /identity/v3/users/e270a2e1b62f4de39a05005623eac58e => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:37.308750 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8524c-05b7-467f-949c-412382b7a5b2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:37.339800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4762ed-fddb-4600-b277-bffd7dc05f22 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:37.373917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73179b1-716d-4f24-a421-17e39c0ecfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:37.374548 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73179b1-716d-4f24-a421-17e39c0ecfd6 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:37.374824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73179b1-716d-4f24-a421-17e39c0ecfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:37.375094 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73179b1-716d-4f24-a421-17e39c0ecfd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:37.376225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73179b1-716d-4f24-a421-17e39c0ecfd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:37.377301 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:37.377844 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73179b1-716d-4f24-a421-17e39c0ecfd6 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:37.379567 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 59/114] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:30:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:37.380332 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73179b1-716d-4f24-a421-17e39c0ecfd6 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:37.412668 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8524c-05b7-467f-949c-412382b7a5b2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:37.448103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370c236-b059-4958-8138-c5d6658d13da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:37.448709 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c236-b059-4958-8138-c5d6658d13da None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:37.448992 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c236-b059-4958-8138-c5d6658d13da None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:37.449268 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c236-b059-4958-8138-c5d6658d13da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:37.480915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73179b1-716d-4f24-a421-17e39c0ecfd6 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:37.495520 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:37.515978 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b58f17-ad62-41ed-a8b4-eaea1ba76a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:37.516711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b58f17-ad62-41ed-a8b4-eaea1ba76a3f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:37.516992 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b58f17-ad62-41ed-a8b4-eaea1ba76a3f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:37.517261 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b58f17-ad62-41ed-a8b4-eaea1ba76a3f None admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:37.518397 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b58f17-ad62-41ed-a8b4-eaea1ba76a3f None admin] RBAC: Authorizing `identity:get_project(project_id=6c41b3079f3f49db85d760bd5ef1f568)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:37.518516 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370c236-b059-4958-8138-c5d6658d13da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:37.519898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b58f17-ad62-41ed-a8b4-eaea1ba76a3f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370c236-b059-4958-8138-c5d6658d13da None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:37.521514 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 60/115] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:37 2022] GET /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:37.522264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b58f17-ad62-41ed-a8b4-eaea1ba76a3f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:37.591558 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:37.622168 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b58f17-ad62-41ed-a8b4-eaea1ba76a3f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:37.628115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 56/116] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:30:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:30:37.628958 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370c236-b059-4958-8138-c5d6658d13da None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:37.659219 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18990487-ca04-456c-8617-f2be4fb3763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:37.659886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18990487-ca04-456c-8617-f2be4fb3763c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:37.660169 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18990487-ca04-456c-8617-f2be4fb3763c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:37.660450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18990487-ca04-456c-8617-f2be4fb3763c None admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:37.661570 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18990487-ca04-456c-8617-f2be4fb3763c None admin] RBAC: Authorizing `identity:get_project(project_id=6c41b3079f3f49db85d760bd5ef1f568)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:37.663071 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18990487-ca04-456c-8617-f2be4fb3763c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:37.664687 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 61/117] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:37 2022] GET /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:37.665445 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18990487-ca04-456c-8617-f2be4fb3763c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:37.714837 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:37.732781 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370c236-b059-4958-8138-c5d6658d13da None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:37.765147 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18990487-ca04-456c-8617-f2be4fb3763c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:37.766635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648174f-3b9c-4377-b519-e4078665ab3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:37.767236 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648174f-3b9c-4377-b519-e4078665ab3b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:37.767550 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648174f-3b9c-4377-b519-e4078665ab3b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:37.768928 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648174f-3b9c-4377-b519-e4078665ab3b None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:37.769598 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648174f-3b9c-4377-b519-e4078665ab3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:37.769901 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648174f-3b9c-4377-b519-e4078665ab3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:37.771293 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648174f-3b9c-4377-b519-e4078665ab3b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:37.780253 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 57/118] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:37.785708 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648174f-3b9c-4377-b519-e4078665ab3b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:37.800571 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38938ab4-0531-4fda-9b7b-62f20a841d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:37.801208 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938ab4-0531-4fda-9b7b-62f20a841d78 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:37.801486 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938ab4-0531-4fda-9b7b-62f20a841d78 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:37.801759 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938ab4-0531-4fda-9b7b-62f20a841d78 None admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:37.802897 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38938ab4-0531-4fda-9b7b-62f20a841d78 None admin] RBAC: Authorizing `identity:get_project(project_id=6c41b3079f3f49db85d760bd5ef1f568)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:37.804451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38938ab4-0531-4fda-9b7b-62f20a841d78 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:37.806371 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 62/119] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:37 2022] GET /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:37.807128 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38938ab4-0531-4fda-9b7b-62f20a841d78 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:37.823457 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:37.895918 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648174f-3b9c-4377-b519-e4078665ab3b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:37.907538 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38938ab4-0531-4fda-9b7b-62f20a841d78 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:37.926289 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:37.930031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e87a61-e24f-459c-936d-023075f999f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:37.930642 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e87a61-e24f-459c-936d-023075f999f6 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:37.930920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e87a61-e24f-459c-936d-023075f999f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:37.931194 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e87a61-e24f-459c-936d-023075f999f6 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:37.931880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e87a61-e24f-459c-936d-023075f999f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:37.933370 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e87a61-e24f-459c-936d-023075f999f6 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:37.944396 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1fd3a-e06c-4aa7-837c-ca08fa5387d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:37.945005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1fd3a-e06c-4aa7-837c-ca08fa5387d6 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:37.945292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1fd3a-e06c-4aa7-837c-ca08fa5387d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:37.945563 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1fd3a-e06c-4aa7-837c-ca08fa5387d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:37.946290 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1fd3a-e06c-4aa7-837c-ca08fa5387d6 None admin] RBAC: Adding query filter params (role.id=d6c014b407594f248f451d331253c8a6, scope.project.id=6c41b3079f3f49db85d760bd5ef1f568, user.id=3ffe1b6ef2a747b697f39f0d31ecd7db) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:37.946600 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1fd3a-e06c-4aa7-837c-ca08fa5387d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:37.948076 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1fd3a-e06c-4aa7-837c-ca08fa5387d6 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:37.953795 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 63/120] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:30:37 2022] GET /identity/v3/role_assignments?user.id=3ffe1b6ef2a747b697f39f0d31ecd7db&scope.project.id=6c41b3079f3f49db85d760bd5ef1f568&role.id=d6c014b407594f248f451d331253c8a6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:37.960027 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1fd3a-e06c-4aa7-837c-ca08fa5387d6 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 58/121] 10.222.0.40 () {60 vars in 1141 bytes} [Sat Oct 29 20:30:37 2022] POST /identity/v3/projects => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:30:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e87a61-e24f-459c-936d-023075f999f6 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:38.090654 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:38.115619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1fd3a-e06c-4aa7-837c-ca08fa5387d6 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:38.117788 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e87a61-e24f-459c-936d-023075f999f6 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:38.165229 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492e17c-c4ad-4fd0-855b-b2be7488c6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:38.165893 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e17c-c4ad-4fd0-855b-b2be7488c6b3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:38.166174 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e17c-c4ad-4fd0-855b-b2be7488c6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:38.166448 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e17c-c4ad-4fd0-855b-b2be7488c6b3 None admin] PATH_INFO: `/v3/projects/36b83d7cbe174bacb44a8af64e37087b` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:38.167679 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492e17c-c4ad-4fd0-855b-b2be7488c6b3 None admin] RBAC: Authorizing `identity:get_project(project_id=36b83d7cbe174bacb44a8af64e37087b)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:38.168407 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a15ac-c02a-47ca-b014-27058e3b287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:38.169190 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492e17c-c4ad-4fd0-855b-b2be7488c6b3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:38.169547 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a15ac-c02a-47ca-b014-27058e3b287f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:38.170022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a15ac-c02a-47ca-b014-27058e3b287f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:38.170491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a15ac-c02a-47ca-b014-27058e3b287f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:38.171382 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 64/122] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:37 2022] GET /identity/v3/projects/36b83d7cbe174bacb44a8af64e37087b => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:38.172172 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492e17c-c4ad-4fd0-855b-b2be7488c6b3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:38.172499 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a15ac-c02a-47ca-b014-27058e3b287f None admin] RBAC: Adding query filter params (role.id=b2dae64b76124d298b982ee42347b223, scope.project.id=6c41b3079f3f49db85d760bd5ef1f568, user.id=3ffe1b6ef2a747b697f39f0d31ecd7db) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:38.173079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a15ac-c02a-47ca-b014-27058e3b287f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:38.174823 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a15ac-c02a-47ca-b014-27058e3b287f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:38.186847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 59/123] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:30:37 2022] GET /identity/v3/role_assignments?user.id=3ffe1b6ef2a747b697f39f0d31ecd7db&scope.project.id=6c41b3079f3f49db85d760bd5ef1f568&role.id=b2dae64b76124d298b982ee42347b223 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:38.193327 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a15ac-c02a-47ca-b014-27058e3b287f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:38.261490 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:38.338813 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492e17c-c4ad-4fd0-855b-b2be7488c6b3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:38.373203 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a15ac-c02a-47ca-b014-27058e3b287f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:38.385459 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1619-23b4-40e7-8f23-dc244775f240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:38.386122 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1619-23b4-40e7-8f23-dc244775f240 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:38.386404 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1619-23b4-40e7-8f23-dc244775f240 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:38.386677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1619-23b4-40e7-8f23-dc244775f240 None admin] PATH_INFO: `/v3/users/f9beafc3b84548cf9fb3d264e0f50848` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:38.387897 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c1619-23b4-40e7-8f23-dc244775f240 None admin] RBAC: Authorizing `identity:get_user(user_id=f9beafc3b84548cf9fb3d264e0f50848)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:38.389523 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c1619-23b4-40e7-8f23-dc244775f240 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:38.391327 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 65/124] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:38 2022] GET /identity/v3/users/f9beafc3b84548cf9fb3d264e0f50848 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:38.392209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1619-23b4-40e7-8f23-dc244775f240 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:38.433757 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46967ecc-b03c-4783-a23e-79f95d9fed45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:38.433757 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46967ecc-b03c-4783-a23e-79f95d9fed45 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:38.434046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46967ecc-b03c-4783-a23e-79f95d9fed45 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:38.434273 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46967ecc-b03c-4783-a23e-79f95d9fed45 None admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568/users/e270a2e1b62f4de39a05005623eac58e/roles/ef7ddbd2f19b4d6295147f4a6591da72` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:38.438914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46967ecc-b03c-4783-a23e-79f95d9fed45 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c41b3079f3f49db85d760bd5ef1f568, user_id=e270a2e1b62f4de39a05005623eac58e, role_id=ef7ddbd2f19b4d6295147f4a6591da72)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:38.441633 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46967ecc-b03c-4783-a23e-79f95d9fed45 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:38.459116 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 60/125] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:30:38 2022] PUT /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568/users/e270a2e1b62f4de39a05005623eac58e/roles/ef7ddbd2f19b4d6295147f4a6591da72 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:30:38.464785 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46967ecc-b03c-4783-a23e-79f95d9fed45 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:38.483255 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:38.534618 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1619-23b4-40e7-8f23-dc244775f240 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:38.558929 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:38.582783 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea22497-4952-42d3-9f14-9ec5f899c826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:38.583528 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea22497-4952-42d3-9f14-9ec5f899c826 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:38.583813 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea22497-4952-42d3-9f14-9ec5f899c826 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:38.584092 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea22497-4952-42d3-9f14-9ec5f899c826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:38.585009 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea22497-4952-42d3-9f14-9ec5f899c826 None admin] RBAC: Adding query filter params (role.id=b2dae64b76124d298b982ee42347b223, scope.project.id=36b83d7cbe174bacb44a8af64e37087b, user.id=3ffe1b6ef2a747b697f39f0d31ecd7db) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:38.585333 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea22497-4952-42d3-9f14-9ec5f899c826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:38.587007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea22497-4952-42d3-9f14-9ec5f899c826 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:38.594265 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 66/126] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:30:38 2022] GET /identity/v3/role_assignments?user.id=3ffe1b6ef2a747b697f39f0d31ecd7db&scope.project.id=36b83d7cbe174bacb44a8af64e37087b&role.id=b2dae64b76124d298b982ee42347b223 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:38.616357 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46967ecc-b03c-4783-a23e-79f95d9fed45 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:38.659019 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56760cb7-5519-4a95-ada1-be51114b0f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:38.660060 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56760cb7-5519-4a95-ada1-be51114b0f83 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:38.660569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56760cb7-5519-4a95-ada1-be51114b0f83 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:38.661123 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56760cb7-5519-4a95-ada1-be51114b0f83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:38.746568 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56760cb7-5519-4a95-ada1-be51114b0f83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:38.748852 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56760cb7-5519-4a95-ada1-be51114b0f83 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:38.769662 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:38.886395 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 61/127] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:30:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:30:38.891838 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea22497-4952-42d3-9f14-9ec5f899c826 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:39.001555 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea22497-4952-42d3-9f14-9ec5f899c826 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:39.037213 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d58d7-7b78-4491-a2a8-40ead410000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:39.037840 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d58d7-7b78-4491-a2a8-40ead410000f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:39.038118 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d58d7-7b78-4491-a2a8-40ead410000f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:39.038387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d58d7-7b78-4491-a2a8-40ead410000f None admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:39.039521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d58d7-7b78-4491-a2a8-40ead410000f None admin] RBAC: Authorizing `identity:get_project(project_id=6c41b3079f3f49db85d760bd5ef1f568)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:39.040959 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d58d7-7b78-4491-a2a8-40ead410000f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:39.042767 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 67/128] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:38 2022] GET /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:39.048812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56760cb7-5519-4a95-ada1-be51114b0f83 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:39.161416 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56760cb7-5519-4a95-ada1-be51114b0f83 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:39.172332 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:39.198313 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a79a12-8929-4d4a-853a-5ff8c7493521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:39.198915 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a79a12-8929-4d4a-853a-5ff8c7493521 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:39.199199 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a79a12-8929-4d4a-853a-5ff8c7493521 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:39.199507 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a79a12-8929-4d4a-853a-5ff8c7493521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:39.200236 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a79a12-8929-4d4a-853a-5ff8c7493521 None admin] RBAC: Adding query filter params (role.id=9b15e747c88749bfb25139f3bd80b395, scope.project.id=6c41b3079f3f49db85d760bd5ef1f568, user.id=f9beafc3b84548cf9fb3d264e0f50848) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:39.200545 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a79a12-8929-4d4a-853a-5ff8c7493521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:39.201995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a79a12-8929-4d4a-853a-5ff8c7493521 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:39.208656 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 62/129] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:30:39 2022] GET /identity/v3/role_assignments?user.id=f9beafc3b84548cf9fb3d264e0f50848&scope.project.id=6c41b3079f3f49db85d760bd5ef1f568&role.id=9b15e747c88749bfb25139f3bd80b395 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:40.557351 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9c3bd-a513-4fb6-a579-7e84d090b069 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:40.557832 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9c3bd-a513-4fb6-a579-7e84d090b069 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:40.557832 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9c3bd-a513-4fb6-a579-7e84d090b069 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:40.559167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 68/130] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:40.564433 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4f96-e43d-47b7-aa9b-366093a6f222 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:40.565330 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4f96-e43d-47b7-aa9b-366093a6f222 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:40.565648 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4f96-e43d-47b7-aa9b-366093a6f222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:40.584304 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-212d4f96-e43d-47b7-aa9b-366093a6f222 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:40.585480 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-212d4f96-e43d-47b7-aa9b-366093a6f222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:40.656270 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 63/131] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:40.980122 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9c3bd-a513-4fb6-a579-7e84d090b069 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:41.024738 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5517b-7ff3-40af-8ab7-30fadd31f670 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:41.025025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5517b-7ff3-40af-8ab7-30fadd31f670 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:41.025302 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5517b-7ff3-40af-8ab7-30fadd31f670 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:41.026622 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 64/132] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:30:41.031486 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481142-0f26-431e-8ce6-5701d39ea1fd None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:41.031766 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481142-0f26-431e-8ce6-5701d39ea1fd None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:41.032045 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481142-0f26-431e-8ce6-5701d39ea1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:41.032183 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:41.050701 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0d481142-0f26-431e-8ce6-5701d39ea1fd None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:41.051925 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0d481142-0f26-431e-8ce6-5701d39ea1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:41.085233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9c3bd-a513-4fb6-a579-7e84d090b069 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:41.118200 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e52846-6330-4cce-969b-e835e905401e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:41.118840 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e52846-6330-4cce-969b-e835e905401e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:41.119092 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 65/133] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:30:41.119225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e52846-6330-4cce-969b-e835e905401e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:41.119414 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e52846-6330-4cce-969b-e835e905401e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:41.120510 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e52846-6330-4cce-969b-e835e905401e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:41.121993 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e52846-6330-4cce-969b-e835e905401e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:41.123689 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 69/134] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:30:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:41.129510 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d481142-0f26-431e-8ce6-5701d39ea1fd None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:41.159117 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:41.225546 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d481142-0f26-431e-8ce6-5701d39ea1fd None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:41.260886 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2e535-92b9-4070-be3d-f0695f2fbe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:41.261492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2e535-92b9-4070-be3d-f0695f2fbe77 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:41.261771 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2e535-92b9-4070-be3d-f0695f2fbe77 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:41.262043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2e535-92b9-4070-be3d-f0695f2fbe77 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:41.262704 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2e535-92b9-4070-be3d-f0695f2fbe77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:41.264177 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2e535-92b9-4070-be3d-f0695f2fbe77 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:41.286534 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 66/135] 10.222.0.40 () {60 vars in 1132 bytes} [Sat Oct 29 20:30:41 2022] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 20:30:41.445939 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e52846-6330-4cce-969b-e835e905401e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:41.553091 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e52846-6330-4cce-969b-e835e905401e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:41.572926 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:41.592841 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4473f-2971-449e-9d24-a4a76a1f9f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:41.593484 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4473f-2971-449e-9d24-a4a76a1f9f70 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:41.593766 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4473f-2971-449e-9d24-a4a76a1f9f70 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:41.594039 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4473f-2971-449e-9d24-a4a76a1f9f70 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:41.605783 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4473f-2971-449e-9d24-a4a76a1f9f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-85f4473f-2971-449e-9d24-a4a76a1f9f70 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:41.611155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:41.612150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:41.613888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:41.613888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:41.613888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:41.613888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:41.613888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:41.613888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:41.613888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:41.613888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:41.613888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:41.613888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:41.613888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 20:30:41.613888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:30:41.613888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 70/136] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:41.619816 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2e535-92b9-4070-be3d-f0695f2fbe77 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:41.712007 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:41.728025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2e535-92b9-4070-be3d-f0695f2fbe77 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:41.770992 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b59f76-e3f5-42a1-9d4e-6847ebef9b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:41.771688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b59f76-e3f5-42a1-9d4e-6847ebef9b62 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:41.771971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b59f76-e3f5-42a1-9d4e-6847ebef9b62 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:41.772244 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b59f76-e3f5-42a1-9d4e-6847ebef9b62 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:41.772917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b59f76-e3f5-42a1-9d4e-6847ebef9b62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:41.773582 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b59f76-e3f5-42a1-9d4e-6847ebef9b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:41.775095 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b59f76-e3f5-42a1-9d4e-6847ebef9b62 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:41.784745 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 67/137] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:30:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:41.790593 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4473f-2971-449e-9d24-a4a76a1f9f70 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:41.906570 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4473f-2971-449e-9d24-a4a76a1f9f70 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:41.943818 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37737718-af2b-49a8-bf92-620c68a37c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:41.944780 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737718-af2b-49a8-bf92-620c68a37c57 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:41.945311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737718-af2b-49a8-bf92-620c68a37c57 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:41.945756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737718-af2b-49a8-bf92-620c68a37c57 None admin] PATH_INFO: `/v3/users/e270a2e1b62f4de39a05005623eac58e` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:41.947174 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37737718-af2b-49a8-bf92-620c68a37c57 None admin] RBAC: Authorizing `identity:get_user(user_id=e270a2e1b62f4de39a05005623eac58e)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:41.948928 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37737718-af2b-49a8-bf92-620c68a37c57 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:41.950723 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 71/138] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:41 2022] GET /identity/v3/users/e270a2e1b62f4de39a05005623eac58e => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:41.958184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b59f76-e3f5-42a1-9d4e-6847ebef9b62 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:42.069705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b59f76-e3f5-42a1-9d4e-6847ebef9b62 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:42.115098 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6ec27-79f0-4ab2-abba-2c68ae28decb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:42.115098 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6ec27-79f0-4ab2-abba-2c68ae28decb None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:42.115098 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6ec27-79f0-4ab2-abba-2c68ae28decb None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:42.115098 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6ec27-79f0-4ab2-abba-2c68ae28decb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:42.136057 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:42.190978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6ec27-79f0-4ab2-abba-2c68ae28decb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:42.192726 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6ec27-79f0-4ab2-abba-2c68ae28decb None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:42.296490 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 68/139] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:30:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:30:42.304509 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37737718-af2b-49a8-bf92-620c68a37c57 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:42.371691 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:42.423449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37737718-af2b-49a8-bf92-620c68a37c57 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:42.459150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b18c6-0bfb-48b6-84e8-dc51c0d4637f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:42.459741 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b18c6-0bfb-48b6-84e8-dc51c0d4637f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:42.460025 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b18c6-0bfb-48b6-84e8-dc51c0d4637f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:42.460300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b18c6-0bfb-48b6-84e8-dc51c0d4637f None admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:42.461426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b18c6-0bfb-48b6-84e8-dc51c0d4637f None admin] RBAC: Authorizing `identity:get_project(project_id=6c41b3079f3f49db85d760bd5ef1f568)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:42.462966 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b18c6-0bfb-48b6-84e8-dc51c0d4637f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:42.464854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 72/140] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:42 2022] GET /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:42.472398 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6ec27-79f0-4ab2-abba-2c68ae28decb None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:42.539336 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:42.577991 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6ec27-79f0-4ab2-abba-2c68ae28decb None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:42.613634 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15211f9-21ac-4851-b7d9-631dc79914ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:42.614242 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15211f9-21ac-4851-b7d9-631dc79914ec None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:42.614517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15211f9-21ac-4851-b7d9-631dc79914ec None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:42.614787 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15211f9-21ac-4851-b7d9-631dc79914ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:42.615532 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15211f9-21ac-4851-b7d9-631dc79914ec None admin] RBAC: Adding query filter params (role.id=ef7ddbd2f19b4d6295147f4a6591da72, scope.project.id=6c41b3079f3f49db85d760bd5ef1f568, user.id=e270a2e1b62f4de39a05005623eac58e) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:42.615836 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15211f9-21ac-4851-b7d9-631dc79914ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:42.617272 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15211f9-21ac-4851-b7d9-631dc79914ec None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:42.623368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 69/141] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:30:42 2022] GET /identity/v3/role_assignments?user.id=e270a2e1b62f4de39a05005623eac58e&scope.project.id=6c41b3079f3f49db85d760bd5ef1f568&role.id=ef7ddbd2f19b4d6295147f4a6591da72 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:43.848808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03920923-d5cf-43fe-8df7-eb8cc3903576 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:43.849330 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03920923-d5cf-43fe-8df7-eb8cc3903576 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:43.849330 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03920923-d5cf-43fe-8df7-eb8cc3903576 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:43.850822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 73/142] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:43.855922 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f3247-5d53-4d16-9d01-1f2ec8fe39f7 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:43.856312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f3247-5d53-4d16-9d01-1f2ec8fe39f7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:43.856464 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f3247-5d53-4d16-9d01-1f2ec8fe39f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:43.875034 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b91f3247-5d53-4d16-9d01-1f2ec8fe39f7 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:43.876258 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b91f3247-5d53-4d16-9d01-1f2ec8fe39f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:43.946600 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 70/143] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:30:44.069255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d00fe0-a07e-4379-b03a-eb502e9a5281 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:44.069637 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d00fe0-a07e-4379-b03a-eb502e9a5281 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:44.069826 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d00fe0-a07e-4379-b03a-eb502e9a5281 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:44.071291 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 74/144] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:44.076522 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc0f73-54c0-4e60-b687-d32f03b5b1d9 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:44.076817 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc0f73-54c0-4e60-b687-d32f03b5b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:44.077097 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc0f73-54c0-4e60-b687-d32f03b5b1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:44.095783 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-97cc0f73-54c0-4e60-b687-d32f03b5b1d9 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:44.096994 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-97cc0f73-54c0-4e60-b687-d32f03b5b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:44.101326 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131d4fb-e788-42a3-9c2b-5bf997b8a5b3 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:44.101546 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131d4fb-e788-42a3-9c2b-5bf997b8a5b3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:44.101809 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131d4fb-e788-42a3-9c2b-5bf997b8a5b3 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:44.103278 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 75/145] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:44.107862 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d24cb1-8076-4691-af71-fe8c5fcc7c12 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:44.108138 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d24cb1-8076-4691-af71-fe8c5fcc7c12 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:44.108411 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d24cb1-8076-4691-af71-fe8c5fcc7c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:44.128567 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-85d24cb1-8076-4691-af71-fe8c5fcc7c12 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:44.129737 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-85d24cb1-8076-4691-af71-fe8c5fcc7c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:44.141022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:44.172668 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 71/146] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:30:44.207712 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 76/147] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:30:44.275373 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc0f73-54c0-4e60-b687-d32f03b5b1d9 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:44.379364 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc0f73-54c0-4e60-b687-d32f03b5b1d9 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:44.412941 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51aa28-1f72-404a-ba85-10f08a95d0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:44.413566 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51aa28-1f72-404a-ba85-10f08a95d0d3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:44.413846 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51aa28-1f72-404a-ba85-10f08a95d0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:44.414119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51aa28-1f72-404a-ba85-10f08a95d0d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:44.424337 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51aa28-1f72-404a-ba85-10f08a95d0d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-4d51aa28-1f72-404a-ba85-10f08a95d0d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:44.429281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:44.430104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:44.431653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:44.431653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:44.431653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:44.431653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:44.431653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:44.431653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:44.431653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:44.431653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:44.431653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:44.431653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:44.431653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:30:44.431653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:44.431653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 72/148] 10.222.0.40 () {56 vars in 1096 bytes} [Sat Oct 29 20:30:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:44.436164 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d24cb1-8076-4691-af71-fe8c5fcc7c12 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:44.485218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:44.504816 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51aa28-1f72-404a-ba85-10f08a95d0d3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:44.541266 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:44.545432 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d24cb1-8076-4691-af71-fe8c5fcc7c12 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:44.579723 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5a67f-33f8-44fe-ad93-834c141c56a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:44.581287 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5a67f-33f8-44fe-ad93-834c141c56a4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:44.581566 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5a67f-33f8-44fe-ad93-834c141c56a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:44.581831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5a67f-33f8-44fe-ad93-834c141c56a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:44.582491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5a67f-33f8-44fe-ad93-834c141c56a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:44.582787 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5a67f-33f8-44fe-ad93-834c141c56a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:44.584202 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5a67f-33f8-44fe-ad93-834c141c56a4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:44.592510 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 77/149] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:44.593301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5a67f-33f8-44fe-ad93-834c141c56a4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:44.611058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51aa28-1f72-404a-ba85-10f08a95d0d3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:44.644693 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8902ed-5b43-4032-a10a-2bf1da66366e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:44.645316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8902ed-5b43-4032-a10a-2bf1da66366e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:44.645589 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8902ed-5b43-4032-a10a-2bf1da66366e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:44.645857 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8902ed-5b43-4032-a10a-2bf1da66366e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:44.655939 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8902ed-5b43-4032-a10a-2bf1da66366e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-6b8902ed-5b43-4032-a10a-2bf1da66366e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:44.661431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:44.662371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:44.664104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:44.664104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:44.664104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:44.664104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:44.664104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:44.664104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:44.664104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:44.664104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:44.664104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:44.664104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:44.664104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:30:44.664104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:44.664104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 73/150] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:30:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:30:44.664104 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8902ed-5b43-4032-a10a-2bf1da66366e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:44.698098 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5a67f-33f8-44fe-ad93-834c141c56a4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:44.705695 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:44.733352 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2c6dc-b896-42d1-a84b-a68a7aecbb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:44.733983 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c6dc-b896-42d1-a84b-a68a7aecbb53 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:44.734262 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c6dc-b896-42d1-a84b-a68a7aecbb53 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:44.734537 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c6dc-b896-42d1-a84b-a68a7aecbb53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:44.735681 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2c6dc-b896-42d1-a84b-a68a7aecbb53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:44.737729 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2c6dc-b896-42d1-a84b-a68a7aecbb53 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:44.739296 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 78/151] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:30:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:44.739296 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2c6dc-b896-42d1-a84b-a68a7aecbb53 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:44.761325 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:44.768003 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8902ed-5b43-4032-a10a-2bf1da66366e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:44.805707 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c8b53-1436-4892-897a-827e8bbb27c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:44.806335 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8b53-1436-4892-897a-827e8bbb27c2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:44.806610 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8b53-1436-4892-897a-827e8bbb27c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:44.806877 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8b53-1436-4892-897a-827e8bbb27c2 None admin] PATH_INFO: `/v3/users/66612d6c7fc74e47adda7ed450107526` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:44.820562 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c8b53-1436-4892-897a-827e8bbb27c2 None admin] RBAC: Authorizing `identity:get_user(user_id=66612d6c7fc74e47adda7ed450107526)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:44.822065 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c8b53-1436-4892-897a-827e8bbb27c2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:44.823832 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 74/152] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:44 2022] GET /identity/v3/users/66612d6c7fc74e47adda7ed450107526 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:44.828739 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c8b53-1436-4892-897a-827e8bbb27c2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:44.844864 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2c6dc-b896-42d1-a84b-a68a7aecbb53 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:44.879717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d1f3e-1147-4bde-b88d-1fba997de45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:44.880313 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1f3e-1147-4bde-b88d-1fba997de45a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:44.880586 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1f3e-1147-4bde-b88d-1fba997de45a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:44.880855 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1f3e-1147-4bde-b88d-1fba997de45a None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:44.881515 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d1f3e-1147-4bde-b88d-1fba997de45a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:44.881816 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d1f3e-1147-4bde-b88d-1fba997de45a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:44.883195 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d1f3e-1147-4bde-b88d-1fba997de45a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:44.891069 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 79/153] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:30:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:44.891892 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d1f3e-1147-4bde-b88d-1fba997de45a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:44.930084 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:44.934216 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c8b53-1436-4892-897a-827e8bbb27c2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:44.967776 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0337cb6-17d2-4d23-8b78-7cee33a0d277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:44.968382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337cb6-17d2-4d23-8b78-7cee33a0d277 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:44.968667 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337cb6-17d2-4d23-8b78-7cee33a0d277 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:44.968938 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337cb6-17d2-4d23-8b78-7cee33a0d277 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:44.969580 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0337cb6-17d2-4d23-8b78-7cee33a0d277 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:44.971761 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0337cb6-17d2-4d23-8b78-7cee33a0d277 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:44.992749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 75/154] 10.222.0.40 () {60 vars in 1132 bytes} [Sat Oct 29 20:30:44 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:30:44.993625 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0337cb6-17d2-4d23-8b78-7cee33a0d277 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:45.005151 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d1f3e-1147-4bde-b88d-1fba997de45a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:45.006385 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:45.051249 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a41e9-f546-41c9-a028-22339947d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:45.052031 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a41e9-f546-41c9-a028-22339947d120 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:45.052315 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a41e9-f546-41c9-a028-22339947d120 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:45.052590 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a41e9-f546-41c9-a028-22339947d120 None admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:45.053780 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a41e9-f546-41c9-a028-22339947d120 None admin] RBAC: Authorizing `identity:get_project(project_id=d2dc0b040d8141b9a5b8c2417b349712)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:45.055338 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a41e9-f546-41c9-a028-22339947d120 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:45.057254 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 80/155] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:44 2022] GET /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:45.063264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a41e9-f546-41c9-a028-22339947d120 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:45.119452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0337cb6-17d2-4d23-8b78-7cee33a0d277 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:45.163125 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739f221-b2d8-46cc-8731-2ccebbc94118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:45.163858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739f221-b2d8-46cc-8731-2ccebbc94118 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:45.164204 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739f221-b2d8-46cc-8731-2ccebbc94118 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:45.164485 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739f221-b2d8-46cc-8731-2ccebbc94118 None admin] PATH_INFO: `/v3/users/66612d6c7fc74e47adda7ed450107526` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:45.165758 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739f221-b2d8-46cc-8731-2ccebbc94118 None admin] RBAC: Authorizing `identity:get_user(user_id=66612d6c7fc74e47adda7ed450107526)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:45.168221 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739f221-b2d8-46cc-8731-2ccebbc94118 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:45.170527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 76/156] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:44 2022] GET /identity/v3/users/66612d6c7fc74e47adda7ed450107526 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:45.176783 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739f221-b2d8-46cc-8731-2ccebbc94118 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:45.197677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a41e9-f546-41c9-a028-22339947d120 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:45.201259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:45.249472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b22cf-a6ea-4980-8b55-4e45dc065845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:45.249472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b22cf-a6ea-4980-8b55-4e45dc065845 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:45.249472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b22cf-a6ea-4980-8b55-4e45dc065845 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:45.249747 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b22cf-a6ea-4980-8b55-4e45dc065845 None admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712/users/66612d6c7fc74e47adda7ed450107526/roles/9b15e747c88749bfb25139f3bd80b395` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:45.254732 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b22cf-a6ea-4980-8b55-4e45dc065845 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2dc0b040d8141b9a5b8c2417b349712, user_id=66612d6c7fc74e47adda7ed450107526, role_id=9b15e747c88749bfb25139f3bd80b395)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:45.260874 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b22cf-a6ea-4980-8b55-4e45dc065845 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:45.279398 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 81/157] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:30:45 2022] PUT /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712/users/66612d6c7fc74e47adda7ed450107526/roles/9b15e747c88749bfb25139f3bd80b395 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 20:30:45.306624 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:45.347407 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739f221-b2d8-46cc-8731-2ccebbc94118 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:45.399654 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c622b6-bcff-4ed3-9cff-c9f65f3cd14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:45.399654 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c622b6-bcff-4ed3-9cff-c9f65f3cd14a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:45.399907 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c622b6-bcff-4ed3-9cff-c9f65f3cd14a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:45.400165 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c622b6-bcff-4ed3-9cff-c9f65f3cd14a None admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:45.401345 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c622b6-bcff-4ed3-9cff-c9f65f3cd14a None admin] RBAC: Authorizing `identity:get_project(project_id=d2dc0b040d8141b9a5b8c2417b349712)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:45.402830 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c622b6-bcff-4ed3-9cff-c9f65f3cd14a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:45.404541 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 77/158] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:45 2022] GET /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:30:45.416773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b22cf-a6ea-4980-8b55-4e45dc065845 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:45.545189 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b22cf-a6ea-4980-8b55-4e45dc065845 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:45.588595 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7fdd9-d08b-4772-95e6-b82803df75f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:45.589641 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7fdd9-d08b-4772-95e6-b82803df75f7 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:45.590118 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7fdd9-d08b-4772-95e6-b82803df75f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:45.590577 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7fdd9-d08b-4772-95e6-b82803df75f7 None admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712/users/66612d6c7fc74e47adda7ed450107526/roles/d6c014b407594f248f451d331253c8a6` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:45.597011 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7fdd9-d08b-4772-95e6-b82803df75f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2dc0b040d8141b9a5b8c2417b349712, user_id=66612d6c7fc74e47adda7ed450107526, role_id=d6c014b407594f248f451d331253c8a6)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:45.598716 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7fdd9-d08b-4772-95e6-b82803df75f7 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:45.615150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 82/159] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:30:45 2022] PUT /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712/users/66612d6c7fc74e47adda7ed450107526/roles/d6c014b407594f248f451d331253c8a6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:30:47.789607 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bdf7d-6efb-46ad-9551-70c94b6f8b97 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:47.789607 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bdf7d-6efb-46ad-9551-70c94b6f8b97 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:47.789607 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bdf7d-6efb-46ad-9551-70c94b6f8b97 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:47.789607 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 78/160] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:47.795868 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e4f3e-ae1f-4204-9ccf-a1dc32d3710d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:47.796561 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e4f3e-ae1f-4204-9ccf-a1dc32d3710d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:47.796696 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e4f3e-ae1f-4204-9ccf-a1dc32d3710d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:47.821401 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-291e4f3e-ae1f-4204-9ccf-a1dc32d3710d None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:47.822705 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-291e4f3e-ae1f-4204-9ccf-a1dc32d3710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:47.845255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:47.907080 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 83/161] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:30:47.988947 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111652b-5b97-471d-9cba-2b6eae8d43d8 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:47.989224 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111652b-5b97-471d-9cba-2b6eae8d43d8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:47.989493 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111652b-5b97-471d-9cba-2b6eae8d43d8 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:47.990987 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 79/162] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:47.999357 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14883701-491b-4277-8390-9ab8f6e18ee0 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:47.999357 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14883701-491b-4277-8390-9ab8f6e18ee0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:47.999357 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14883701-491b-4277-8390-9ab8f6e18ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:48.016847 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-14883701-491b-4277-8390-9ab8f6e18ee0 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:48.018362 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-14883701-491b-4277-8390-9ab8f6e18ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:48.117983 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 84/163] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:48.214323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bdf30-1602-4e0a-b042-35abdb16fc33 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:48.214605 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bdf30-1602-4e0a-b042-35abdb16fc33 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:48.214877 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bdf30-1602-4e0a-b042-35abdb16fc33 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:48.216259 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 80/164] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:48.226094 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1eea4-e1ef-4cea-9eb6-670409608355 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:48.226376 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1eea4-e1ef-4cea-9eb6-670409608355 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:48.226648 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1eea4-e1ef-4cea-9eb6-670409608355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:48.252990 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-38e1eea4-e1ef-4cea-9eb6-670409608355 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:48.254192 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-38e1eea4-e1ef-4cea-9eb6-670409608355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:48.282934 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bdf30-1602-4e0a-b042-35abdb16fc33 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:48.352045 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 85/165] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:48.431859 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce791c-de51-4d56-b6e8-8b9a8e6fb05e None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:48.432177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce791c-de51-4d56-b6e8-8b9a8e6fb05e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:48.432438 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce791c-de51-4d56-b6e8-8b9a8e6fb05e None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:48.433775 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 86/166] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:48.442000 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cce149-7927-48f1-ae20-616521197a79 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:48.442281 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cce149-7927-48f1-ae20-616521197a79 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:48.442675 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cce149-7927-48f1-ae20-616521197a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:48.469985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bdf30-1602-4e0a-b042-35abdb16fc33 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:48.492547 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-24cce149-7927-48f1-ae20-616521197a79 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:48.493739 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-24cce149-7927-48f1-ae20-616521197a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:48.513412 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3f827-b188-4d1f-b725-beb2ea69e284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:48.513629 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:48.514888 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3f827-b188-4d1f-b725-beb2ea69e284 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:48.515144 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3f827-b188-4d1f-b725-beb2ea69e284 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:48.515427 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3f827-b188-4d1f-b725-beb2ea69e284 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:48.531918 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3f827-b188-4d1f-b725-beb2ea69e284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-9fa3f827-b188-4d1f-b725-beb2ea69e284 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:48.538062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:48.538927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:48.539740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:48.539740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:48.539740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:48.539740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:48.539740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:48.539740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:48.539740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:48.539740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:48.539740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:48.539740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:48.539740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:30:48.539740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:48.541360 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 81/167] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:48.541360 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3f827-b188-4d1f-b725-beb2ea69e284 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:48.545338 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:48.594775 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 87/168] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:48.597707 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cce149-7927-48f1-ae20-616521197a79 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:48.699773 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3f827-b188-4d1f-b725-beb2ea69e284 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:48.745999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489882e-aa80-402d-9e25-1c323dca4acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:48.746636 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489882e-aa80-402d-9e25-1c323dca4acb None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:48.747079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489882e-aa80-402d-9e25-1c323dca4acb None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:48.747415 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489882e-aa80-402d-9e25-1c323dca4acb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:48.752332 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cce149-7927-48f1-ae20-616521197a79 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:48.760687 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489882e-aa80-402d-9e25-1c323dca4acb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-2489882e-aa80-402d-9e25-1c323dca4acb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:48.766559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:48.767995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:48.768829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:48.768829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:48.768829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:48.768829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:48.768829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:48.768829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:48.768829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:48.768829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:48.768829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:48.768829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:48.768829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:30:48.768829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:48.771844 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 82/169] 10.222.0.40 () {56 vars in 1096 bytes} [Sat Oct 29 20:30:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:48.777043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489882e-aa80-402d-9e25-1c323dca4acb None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:48.801171 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3c095-b088-4042-a37c-7623cf5ec5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:48.801831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3c095-b088-4042-a37c-7623cf5ec5d4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:48.802118 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3c095-b088-4042-a37c-7623cf5ec5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:48.802386 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3c095-b088-4042-a37c-7623cf5ec5d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:48.803056 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3c095-b088-4042-a37c-7623cf5ec5d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:48.803433 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3c095-b088-4042-a37c-7623cf5ec5d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:48.804846 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3c095-b088-4042-a37c-7623cf5ec5d4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:48.816976 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 88/170] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:30:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:48.817642 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3c095-b088-4042-a37c-7623cf5ec5d4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:48.835254 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:48.903439 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:48.969509 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489882e-aa80-402d-9e25-1c323dca4acb None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:48.993738 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3c095-b088-4042-a37c-7623cf5ec5d4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:49.009192 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790e1a9-40c2-4253-b4f8-513d5412a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:49.010222 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790e1a9-40c2-4253-b4f8-513d5412a3da None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:49.010511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790e1a9-40c2-4253-b4f8-513d5412a3da None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:49.010781 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790e1a9-40c2-4253-b4f8-513d5412a3da None admin] PATH_INFO: `/v3/domains/default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:49.014022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790e1a9-40c2-4253-b4f8-513d5412a3da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:49.015526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790e1a9-40c2-4253-b4f8-513d5412a3da None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:49.017098 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 83/171] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:30:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:49.018613 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790e1a9-40c2-4253-b4f8-513d5412a3da None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:49.043710 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc68991-dc14-4c28-8f3f-77eb8bfec148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:49.044335 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc68991-dc14-4c28-8f3f-77eb8bfec148 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:49.044623 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc68991-dc14-4c28-8f3f-77eb8bfec148 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:49.044893 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc68991-dc14-4c28-8f3f-77eb8bfec148 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:49.045596 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc68991-dc14-4c28-8f3f-77eb8bfec148 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:49.045861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc68991-dc14-4c28-8f3f-77eb8bfec148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:49.047728 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc68991-dc14-4c28-8f3f-77eb8bfec148 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:49.063356 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 89/172] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:49.063356 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc68991-dc14-4c28-8f3f-77eb8bfec148 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:49.138770 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:49.159016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790e1a9-40c2-4253-b4f8-513d5412a3da None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:49.180489 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc68991-dc14-4c28-8f3f-77eb8bfec148 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:49.193448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:49.201029 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99b135-0934-43d3-a00f-1c839c4ff504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:49.201663 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99b135-0934-43d3-a00f-1c839c4ff504 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:49.201928 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99b135-0934-43d3-a00f-1c839c4ff504 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:49.202195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99b135-0934-43d3-a00f-1c839c4ff504 None admin] PATH_INFO: `/v3/users/36f6f59ed7b74d5a8e1f5f374a48e8ec` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:49.219796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99b135-0934-43d3-a00f-1c839c4ff504 None admin] RBAC: Authorizing `identity:get_user(user_id=36f6f59ed7b74d5a8e1f5f374a48e8ec)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:49.221457 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99b135-0934-43d3-a00f-1c839c4ff504 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:49.223192 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 84/173] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:49 2022] GET /identity/v3/users/36f6f59ed7b74d5a8e1f5f374a48e8ec => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:49.224019 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99b135-0934-43d3-a00f-1c839c4ff504 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:49.230169 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f805f7f-2f10-4d97-99dd-2758859016fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:49.230169 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805f7f-2f10-4d97-99dd-2758859016fb None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:49.230169 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805f7f-2f10-4d97-99dd-2758859016fb None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:49.230169 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805f7f-2f10-4d97-99dd-2758859016fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:49.253815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f805f7f-2f10-4d97-99dd-2758859016fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-6f805f7f-2f10-4d97-99dd-2758859016fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:49.262822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:49.263930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:49.264866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:49.264866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:49.264866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:49.264866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:49.264866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:49.264866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:49.264866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:49.264866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:49.264866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:49.264866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:49.264866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:30:49.264866 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:30:49.266745 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 90/174] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:30:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:49.273335 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f805f7f-2f10-4d97-99dd-2758859016fb None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:49.354995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99b135-0934-43d3-a00f-1c839c4ff504 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:49.391547 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde0d62-3944-44f5-ba6c-6a3cf861164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:49.392160 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0d62-3944-44f5-ba6c-6a3cf861164d None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:49.392992 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f805f7f-2f10-4d97-99dd-2758859016fb None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:49.393179 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0d62-3944-44f5-ba6c-6a3cf861164d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:49.393285 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0d62-3944-44f5-ba6c-6a3cf861164d None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:49.393920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde0d62-3944-44f5-ba6c-6a3cf861164d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:49.396392 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde0d62-3944-44f5-ba6c-6a3cf861164d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:49.420570 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 85/175] 10.222.0.40 () {60 vars in 1132 bytes} [Sat Oct 29 20:30:49 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:30:49.435600 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde0d62-3944-44f5-ba6c-6a3cf861164d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:49.435728 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:49.435728 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d2c3-24c3-46e3-afc2-4a777d71e29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:49.435728 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d2c3-24c3-46e3-afc2-4a777d71e29f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:49.435728 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d2c3-24c3-46e3-afc2-4a777d71e29f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:49.436028 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d2c3-24c3-46e3-afc2-4a777d71e29f None admin] PATH_INFO: `/v3/users/66612d6c7fc74e47adda7ed450107526` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:49.436028 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575d2c3-24c3-46e3-afc2-4a777d71e29f None admin] RBAC: Authorizing `identity:get_user(user_id=66612d6c7fc74e47adda7ed450107526)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:49.437507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575d2c3-24c3-46e3-afc2-4a777d71e29f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:49.444733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 91/176] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:49 2022] GET /identity/v3/users/66612d6c7fc74e47adda7ed450107526 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:49.444733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d2c3-24c3-46e3-afc2-4a777d71e29f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:49.490442 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:49.575329 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde0d62-3944-44f5-ba6c-6a3cf861164d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:49.575527 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d2c3-24c3-46e3-afc2-4a777d71e29f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:49.623692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844f0b3-4fc9-464b-8e72-18ded202aaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:49.623692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844f0b3-4fc9-464b-8e72-18ded202aaa9 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:49.624051 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844f0b3-4fc9-464b-8e72-18ded202aaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:49.624300 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844f0b3-4fc9-464b-8e72-18ded202aaa9 None admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:49.625514 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844f0b3-4fc9-464b-8e72-18ded202aaa9 None admin] RBAC: Authorizing `identity:get_project(project_id=d2dc0b040d8141b9a5b8c2417b349712)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:49.628030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844f0b3-4fc9-464b-8e72-18ded202aaa9 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:49.629128 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66cf62-91b2-4d8c-bf02-6c48a50056e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:49.629985 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66cf62-91b2-4d8c-bf02-6c48a50056e3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:49.630268 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66cf62-91b2-4d8c-bf02-6c48a50056e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:49.630541 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66cf62-91b2-4d8c-bf02-6c48a50056e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:49.632801 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66cf62-91b2-4d8c-bf02-6c48a50056e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:49.632801 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66cf62-91b2-4d8c-bf02-6c48a50056e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:49.633362 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66cf62-91b2-4d8c-bf02-6c48a50056e3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:49.635715 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 86/177] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:49 2022] GET /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:49.637339 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844f0b3-4fc9-464b-8e72-18ded202aaa9 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:49.648530 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 92/178] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:30:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:49.648530 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66cf62-91b2-4d8c-bf02-6c48a50056e3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:49.729050 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:49.798371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844f0b3-4fc9-464b-8e72-18ded202aaa9 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:49.806593 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66cf62-91b2-4d8c-bf02-6c48a50056e3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:49.812955 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:49.837996 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f866d-caff-4e4d-a88c-218985e6a606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:49.838583 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f866d-caff-4e4d-a88c-218985e6a606 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:49.838873 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f866d-caff-4e4d-a88c-218985e6a606 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:49.839151 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f866d-caff-4e4d-a88c-218985e6a606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:49.859035 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db83189-3086-4826-9463-64bd1523f229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:49.860078 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db83189-3086-4826-9463-64bd1523f229 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:49.864041 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db83189-3086-4826-9463-64bd1523f229 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:49.864563 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db83189-3086-4826-9463-64bd1523f229 None admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712/users/36f6f59ed7b74d5a8e1f5f374a48e8ec/roles/b2dae64b76124d298b982ee42347b223` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:49.872392 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db83189-3086-4826-9463-64bd1523f229 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2dc0b040d8141b9a5b8c2417b349712, user_id=36f6f59ed7b74d5a8e1f5f374a48e8ec, role_id=b2dae64b76124d298b982ee42347b223)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:49.874359 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db83189-3086-4826-9463-64bd1523f229 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:49.911407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 93/179] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:30:49 2022] PUT /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712/users/36f6f59ed7b74d5a8e1f5f374a48e8ec/roles/b2dae64b76124d298b982ee42347b223 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:30:49.912863 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db83189-3086-4826-9463-64bd1523f229 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:49.965783 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f866d-caff-4e4d-a88c-218985e6a606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:49.968708 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f866d-caff-4e4d-a88c-218985e6a606 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:50.098453 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db83189-3086-4826-9463-64bd1523f229 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:50.136871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:50.182855 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c571b-e19c-41d0-922a-ba3bfc926996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:50.183540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c571b-e19c-41d0-922a-ba3bfc926996 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:50.183818 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c571b-e19c-41d0-922a-ba3bfc926996 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:50.184132 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c571b-e19c-41d0-922a-ba3bfc926996 None admin] PATH_INFO: `/v3/users/66612d6c7fc74e47adda7ed450107526` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:50.186351 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c571b-e19c-41d0-922a-ba3bfc926996 None admin] RBAC: Authorizing `identity:get_user(user_id=66612d6c7fc74e47adda7ed450107526)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:50.187896 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c571b-e19c-41d0-922a-ba3bfc926996 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:50.190356 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 94/180] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:49 2022] GET /identity/v3/users/66612d6c7fc74e47adda7ed450107526 => generated 283 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:50.199212 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c571b-e19c-41d0-922a-ba3bfc926996 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:50.233669 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 87/181] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:30:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:30:50.240448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f866d-caff-4e4d-a88c-218985e6a606 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:50.273874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:50.424738 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c571b-e19c-41d0-922a-ba3bfc926996 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:50.465429 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f866d-caff-4e4d-a88c-218985e6a606 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:50.477056 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63301bc-4555-483b-8a58-f163810ff691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:50.477688 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63301bc-4555-483b-8a58-f163810ff691 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:50.477969 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63301bc-4555-483b-8a58-f163810ff691 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:50.478241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63301bc-4555-483b-8a58-f163810ff691 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:50.567036 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980381b7-cf74-4ac5-83fe-12b7b01da002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:50.567711 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980381b7-cf74-4ac5-83fe-12b7b01da002 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:50.567986 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980381b7-cf74-4ac5-83fe-12b7b01da002 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:50.568252 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980381b7-cf74-4ac5-83fe-12b7b01da002 None admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:50.569739 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:50.570429 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980381b7-cf74-4ac5-83fe-12b7b01da002 None admin] RBAC: Authorizing `identity:get_project(project_id=d2dc0b040d8141b9a5b8c2417b349712)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:50.571912 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980381b7-cf74-4ac5-83fe-12b7b01da002 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:50.581505 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 88/182] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:50 2022] GET /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712 => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:30:50.587323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980381b7-cf74-4ac5-83fe-12b7b01da002 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:50.598759 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63301bc-4555-483b-8a58-f163810ff691 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:50.600287 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63301bc-4555-483b-8a58-f163810ff691 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:50.731536 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:50.789397 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980381b7-cf74-4ac5-83fe-12b7b01da002 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:50.851724 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 95/183] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:30:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:30:50.853070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e3b65-22bb-4dcb-b295-d08e5ddb114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:50.853928 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e3b65-22bb-4dcb-b295-d08e5ddb114c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:50.854404 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e3b65-22bb-4dcb-b295-d08e5ddb114c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:50.854883 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e3b65-22bb-4dcb-b295-d08e5ddb114c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:50.855996 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e3b65-22bb-4dcb-b295-d08e5ddb114c None admin] RBAC: Adding query filter params (role.id=9b15e747c88749bfb25139f3bd80b395, scope.project.id=d2dc0b040d8141b9a5b8c2417b349712, user.id=66612d6c7fc74e47adda7ed450107526) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:50.857033 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63301bc-4555-483b-8a58-f163810ff691 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:50.865701 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e3b65-22bb-4dcb-b295-d08e5ddb114c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:50.867515 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e3b65-22bb-4dcb-b295-d08e5ddb114c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:50.883814 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 89/184] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:30:50 2022] GET /identity/v3/role_assignments?user.id=66612d6c7fc74e47adda7ed450107526&scope.project.id=d2dc0b040d8141b9a5b8c2417b349712&role.id=9b15e747c88749bfb25139f3bd80b395 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:51.049244 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:51.075698 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63301bc-4555-483b-8a58-f163810ff691 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:51.156163 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c0e92-3ea9-468c-a4cd-98973813af2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:51.156838 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c0e92-3ea9-468c-a4cd-98973813af2e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:51.157119 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c0e92-3ea9-468c-a4cd-98973813af2e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:51.157392 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c0e92-3ea9-468c-a4cd-98973813af2e None admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:51.159216 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c0e92-3ea9-468c-a4cd-98973813af2e None admin] RBAC: Authorizing `identity:get_project(project_id=d2dc0b040d8141b9a5b8c2417b349712)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:51.160840 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c0e92-3ea9-468c-a4cd-98973813af2e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:51.162733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 96/185] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:50 2022] GET /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:51.169001 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e3b65-22bb-4dcb-b295-d08e5ddb114c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:51.351765 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e3b65-22bb-4dcb-b295-d08e5ddb114c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:51.393779 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63f5eb-e608-491c-ae1b-27240a9c9e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:51.394393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63f5eb-e608-491c-ae1b-27240a9c9e99 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:51.394672 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63f5eb-e608-491c-ae1b-27240a9c9e99 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:51.394941 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63f5eb-e608-491c-ae1b-27240a9c9e99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:51.395741 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63f5eb-e608-491c-ae1b-27240a9c9e99 None admin] RBAC: Adding query filter params (role.id=d6c014b407594f248f451d331253c8a6, scope.project.id=d2dc0b040d8141b9a5b8c2417b349712, user.id=66612d6c7fc74e47adda7ed450107526) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:51.396052 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63f5eb-e608-491c-ae1b-27240a9c9e99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:51.397510 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63f5eb-e608-491c-ae1b-27240a9c9e99 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:51.403887 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 90/186] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:30:51 2022] GET /identity/v3/role_assignments?user.id=66612d6c7fc74e47adda7ed450107526&scope.project.id=d2dc0b040d8141b9a5b8c2417b349712&role.id=d6c014b407594f248f451d331253c8a6 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:52.445449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df202b1f-120b-4930-81af-dbfc18f52ba9 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:52.445449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df202b1f-120b-4930-81af-dbfc18f52ba9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:52.445449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df202b1f-120b-4930-81af-dbfc18f52ba9 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:52.446213 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 97/187] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:52.451237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce0d2-b9d2-4345-a05f-bf1d6e97ed77 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:52.451690 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce0d2-b9d2-4345-a05f-bf1d6e97ed77 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:52.451898 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce0d2-b9d2-4345-a05f-bf1d6e97ed77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:52.472600 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-518ce0d2-b9d2-4345-a05f-bf1d6e97ed77 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:52.474209 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-518ce0d2-b9d2-4345-a05f-bf1d6e97ed77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:52.475867 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013185a4-55af-42df-9c70-86152da33902 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:52.476151 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013185a4-55af-42df-9c70-86152da33902 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:52.476420 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013185a4-55af-42df-9c70-86152da33902 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:52.477747 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:52.477910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 98/188] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:52.485879 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a09f7b-372b-4ea3-bf38-5c58e0394131 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:52.486528 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a09f7b-372b-4ea3-bf38-5c58e0394131 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:52.487194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a09f7b-372b-4ea3-bf38-5c58e0394131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:52.508419 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-31a09f7b-372b-4ea3-bf38-5c58e0394131 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:52.509655 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-31a09f7b-372b-4ea3-bf38-5c58e0394131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:52.559603 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 91/189] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:52.593903 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 99/190] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:30:52.815749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06c47-df71-45af-bfad-674088c70935 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:52.816357 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06c47-df71-45af-bfad-674088c70935 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:52.816835 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06c47-df71-45af-bfad-674088c70935 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:52.819685 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 92/191] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:52.825166 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc46afb-db81-4289-b4fe-db8640cabded None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:52.825454 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc46afb-db81-4289-b4fe-db8640cabded None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:52.825729 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc46afb-db81-4289-b4fe-db8640cabded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:52.847853 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-abc46afb-db81-4289-b4fe-db8640cabded None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:52.849352 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-abc46afb-db81-4289-b4fe-db8640cabded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:52.902652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d06c47-df71-45af-bfad-674088c70935 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:52.932330 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 100/192] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:30:52.940567 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc46afb-db81-4289-b4fe-db8640cabded None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:52.956666 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:53.042312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d06c47-df71-45af-bfad-674088c70935 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:53.054223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc46afb-db81-4289-b4fe-db8640cabded None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:53.090471 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d2a2c-2aa4-4f04-8a3c-88307e9e60b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:53.091360 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d2a2c-2aa4-4f04-8a3c-88307e9e60b5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:53.091800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d2a2c-2aa4-4f04-8a3c-88307e9e60b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:53.092218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d2a2c-2aa4-4f04-8a3c-88307e9e60b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:53.094504 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22ae8b-52f8-4355-899d-470c7e3e6bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:53.095233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22ae8b-52f8-4355-899d-470c7e3e6bd7 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:53.095920 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22ae8b-52f8-4355-899d-470c7e3e6bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:53.096397 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22ae8b-52f8-4355-899d-470c7e3e6bd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:53.098018 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22ae8b-52f8-4355-899d-470c7e3e6bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:53.099844 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22ae8b-52f8-4355-899d-470c7e3e6bd7 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:53.101355 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:53.101910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 101/193] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:30:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:30:53.105076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d2a2c-2aa4-4f04-8a3c-88307e9e60b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:53.107487 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22ae8b-52f8-4355-899d-470c7e3e6bd7 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-888d2a2c-2aa4-4f04-8a3c-88307e9e60b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:53.111581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:53.112561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:53.113353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:53.113353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:53.113353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:53.113353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:53.113353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:53.113353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:53.113353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:53.113353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:53.113353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:53.113353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:53.113353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 20:30:53.113353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:53.118192 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 93/194] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:30:53.122519 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d2a2c-2aa4-4f04-8a3c-88307e9e60b5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:53.214170 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:53.240324 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22ae8b-52f8-4355-899d-470c7e3e6bd7 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:53.265568 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d2a2c-2aa4-4f04-8a3c-88307e9e60b5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:53.284056 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39df3b-386e-478e-92eb-5082efe059ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:53.285410 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39df3b-386e-478e-92eb-5082efe059ac None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:53.285683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39df3b-386e-478e-92eb-5082efe059ac None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:53.285944 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39df3b-386e-478e-92eb-5082efe059ac None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:53.286743 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39df3b-386e-478e-92eb-5082efe059ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:53.288301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39df3b-386e-478e-92eb-5082efe059ac None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:53.305726 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4f3a4-0dfd-45f4-8166-583deaf48270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:53.306338 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4f3a4-0dfd-45f4-8166-583deaf48270 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:53.306615 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4f3a4-0dfd-45f4-8166-583deaf48270 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:53.306884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4f3a4-0dfd-45f4-8166-583deaf48270 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:53.307589 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4f3a4-0dfd-45f4-8166-583deaf48270 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:53.307887 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4f3a4-0dfd-45f4-8166-583deaf48270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:53.309387 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4f3a4-0dfd-45f4-8166-583deaf48270 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:53.318498 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 102/195] 10.222.0.40 () {60 vars in 1132 bytes} [Sat Oct 29 20:30:53 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 20:30:53.319147 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 94/196] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:30:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:30:53.325225 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4f3a4-0dfd-45f4-8166-583deaf48270 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:53.328743 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39df3b-386e-478e-92eb-5082efe059ac None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:53.411950 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:53.472930 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4f3a4-0dfd-45f4-8166-583deaf48270 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:53.473591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39df3b-386e-478e-92eb-5082efe059ac None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:53.516891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768f350-1f14-4ea4-84ed-d4a8c851bf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:53.518708 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768f350-1f14-4ea4-84ed-d4a8c851bf2c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:53.519137 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768f350-1f14-4ea4-84ed-d4a8c851bf2c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:53.519577 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768f350-1f14-4ea4-84ed-d4a8c851bf2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:53.519967 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09f14f-1158-43e0-a27a-7fb7891f89b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:53.520682 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09f14f-1158-43e0-a27a-7fb7891f89b5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:53.521026 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09f14f-1158-43e0-a27a-7fb7891f89b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:53.521371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09f14f-1158-43e0-a27a-7fb7891f89b5 None admin] PATH_INFO: `/v3/users/08a461efa9fc47b895d4b827fd5ed899` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:53.529227 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:53.535719 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768f350-1f14-4ea4-84ed-d4a8c851bf2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:53.541543 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09f14f-1158-43e0-a27a-7fb7891f89b5 None admin] RBAC: Authorizing `identity:get_user(user_id=08a461efa9fc47b895d4b827fd5ed899)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-2768f350-1f14-4ea4-84ed-d4a8c851bf2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:53.542146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:53.542980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:53.543800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:53.543800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:53.543800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:53.543800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:53.543800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:53.543800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:53.543800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:53.543800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:53.543800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:53.543800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:53.543800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:30:53.543800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:30:53.543800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 103/197] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:53.548987 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09f14f-1158-43e0-a27a-7fb7891f89b5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:53.549692 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768f350-1f14-4ea4-84ed-d4a8c851bf2c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:53.551063 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 95/198] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:53 2022] GET /identity/v3/users/08a461efa9fc47b895d4b827fd5ed899 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:53.557391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09f14f-1158-43e0-a27a-7fb7891f89b5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:53.710271 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768f350-1f14-4ea4-84ed-d4a8c851bf2c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:53.740302 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09f14f-1158-43e0-a27a-7fb7891f89b5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:53.763995 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8d819-2ae8-4907-86bb-7f33386d597a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:53.764933 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8d819-2ae8-4907-86bb-7f33386d597a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:53.765390 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8d819-2ae8-4907-86bb-7f33386d597a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:53.765850 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8d819-2ae8-4907-86bb-7f33386d597a None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:53.766705 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8d819-2ae8-4907-86bb-7f33386d597a None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:53.767148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8d819-2ae8-4907-86bb-7f33386d597a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:53.768639 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:53.769455 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8d819-2ae8-4907-86bb-7f33386d597a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:53.782242 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 104/199] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:30:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:30:53.789675 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8d819-2ae8-4907-86bb-7f33386d597a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:53.791323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16bc7d-2840-44c2-81af-8d01d97b55a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:53.794042 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16bc7d-2840-44c2-81af-8d01d97b55a5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:53.794552 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16bc7d-2840-44c2-81af-8d01d97b55a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:53.795032 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16bc7d-2840-44c2-81af-8d01d97b55a5 None admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:53.796723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16bc7d-2840-44c2-81af-8d01d97b55a5 None admin] RBAC: Authorizing `identity:get_project(project_id=d2dc0b040d8141b9a5b8c2417b349712)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:53.798356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16bc7d-2840-44c2-81af-8d01d97b55a5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:53.800824 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 96/200] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:53 2022] GET /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:53.811437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16bc7d-2840-44c2-81af-8d01d97b55a5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:53.903337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:53.967583 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8d819-2ae8-4907-86bb-7f33386d597a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:53.967950 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16bc7d-2840-44c2-81af-8d01d97b55a5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:54.015198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fa38f-0a24-4388-a747-79c4a4bd6765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:54.016260 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fa38f-0a24-4388-a747-79c4a4bd6765 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:54.016732 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fa38f-0a24-4388-a747-79c4a4bd6765 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:54.017148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fa38f-0a24-4388-a747-79c4a4bd6765 None admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712/users/08a461efa9fc47b895d4b827fd5ed899/roles/ef7ddbd2f19b4d6295147f4a6591da72` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:54.019505 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fa38f-0a24-4388-a747-79c4a4bd6765 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2dc0b040d8141b9a5b8c2417b349712, user_id=08a461efa9fc47b895d4b827fd5ed899, role_id=ef7ddbd2f19b4d6295147f4a6591da72)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:54.021332 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fa38f-0a24-4388-a747-79c4a4bd6765 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:54.025683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe234b-92df-48ad-967a-22c0537df121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:54.026636 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe234b-92df-48ad-967a-22c0537df121 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:54.026988 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe234b-92df-48ad-967a-22c0537df121 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:54.027532 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe234b-92df-48ad-967a-22c0537df121 None admin] PATH_INFO: `/v3/users/36f6f59ed7b74d5a8e1f5f374a48e8ec` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:54.029073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe234b-92df-48ad-967a-22c0537df121 None admin] RBAC: Authorizing `identity:get_user(user_id=36f6f59ed7b74d5a8e1f5f374a48e8ec)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:54.030683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe234b-92df-48ad-967a-22c0537df121 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:54.035659 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 105/201] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:53 2022] GET /identity/v3/users/36f6f59ed7b74d5a8e1f5f374a48e8ec => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:54.041744 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 97/202] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:30:53 2022] PUT /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712/users/08a461efa9fc47b895d4b827fd5ed899/roles/ef7ddbd2f19b4d6295147f4a6591da72 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:30:54.048818 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe234b-92df-48ad-967a-22c0537df121 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:54.176869 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe234b-92df-48ad-967a-22c0537df121 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:54.213854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:54.219060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a2592-dbd7-4b8c-a3c4-aeec3b9da49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:54.219744 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a2592-dbd7-4b8c-a3c4-aeec3b9da49f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:54.220051 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a2592-dbd7-4b8c-a3c4-aeec3b9da49f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:54.220333 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a2592-dbd7-4b8c-a3c4-aeec3b9da49f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:54.308424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a2592-dbd7-4b8c-a3c4-aeec3b9da49f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:54.310227 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a2592-dbd7-4b8c-a3c4-aeec3b9da49f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:54.445627 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 106/203] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:30:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:30:54.451635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fa38f-0a24-4388-a747-79c4a4bd6765 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:54.510261 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:54.569838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fa38f-0a24-4388-a747-79c4a4bd6765 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:54.608068 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740f331-a424-46ac-b0dd-ba03a0ecb84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:54.608707 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740f331-a424-46ac-b0dd-ba03a0ecb84a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:54.608983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740f331-a424-46ac-b0dd-ba03a0ecb84a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:54.609253 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740f331-a424-46ac-b0dd-ba03a0ecb84a None admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:54.610410 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740f331-a424-46ac-b0dd-ba03a0ecb84a None admin] RBAC: Authorizing `identity:get_project(project_id=d2dc0b040d8141b9a5b8c2417b349712)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:54.612837 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740f331-a424-46ac-b0dd-ba03a0ecb84a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:54.614476 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 98/204] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:54 2022] GET /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:54.622374 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a2592-dbd7-4b8c-a3c4-aeec3b9da49f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:54.653716 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:54.738787 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a2592-dbd7-4b8c-a3c4-aeec3b9da49f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:54.777747 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265612b-8b3e-4bbb-85d7-9d7427fb30b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:54.778704 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265612b-8b3e-4bbb-85d7-9d7427fb30b4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:54.779185 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265612b-8b3e-4bbb-85d7-9d7427fb30b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:54.779700 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265612b-8b3e-4bbb-85d7-9d7427fb30b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:54.780595 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265612b-8b3e-4bbb-85d7-9d7427fb30b4 None admin] RBAC: Adding query filter params (role.id=b2dae64b76124d298b982ee42347b223, scope.project.id=d2dc0b040d8141b9a5b8c2417b349712, user.id=36f6f59ed7b74d5a8e1f5f374a48e8ec) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:54.781048 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265612b-8b3e-4bbb-85d7-9d7427fb30b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:54.782656 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265612b-8b3e-4bbb-85d7-9d7427fb30b4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:54.797720 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 107/205] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:30:54 2022] GET /identity/v3/role_assignments?user.id=36f6f59ed7b74d5a8e1f5f374a48e8ec&scope.project.id=d2dc0b040d8141b9a5b8c2417b349712&role.id=b2dae64b76124d298b982ee42347b223 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:56.133113 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84164-bb0c-4129-9ebb-08e500329f52 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:56.133113 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84164-bb0c-4129-9ebb-08e500329f52 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:56.133113 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84164-bb0c-4129-9ebb-08e500329f52 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:56.134130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 99/206] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:56.139926 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03a8e0-4acc-40ce-86ae-9dc7d29d9e6c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:56.140354 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03a8e0-4acc-40ce-86ae-9dc7d29d9e6c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:56.140493 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03a8e0-4acc-40ce-86ae-9dc7d29d9e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:56.162693 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-bc03a8e0-4acc-40ce-86ae-9dc7d29d9e6c None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:56.164203 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bc03a8e0-4acc-40ce-86ae-9dc7d29d9e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:56.245523 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 108/207] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:56.295655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04722e-3884-4e03-aa11-c18cf2261a67 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:56.297064 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04722e-3884-4e03-aa11-c18cf2261a67 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:56.297064 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04722e-3884-4e03-aa11-c18cf2261a67 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:56.298022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 100/208] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:56.304410 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb81f95-02e0-4dde-a53a-6c08b6c39b1a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:56.304410 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb81f95-02e0-4dde-a53a-6c08b6c39b1a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:56.304706 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb81f95-02e0-4dde-a53a-6c08b6c39b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:56.326718 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8fb81f95-02e0-4dde-a53a-6c08b6c39b1a None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:56.328203 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8fb81f95-02e0-4dde-a53a-6c08b6c39b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:56.347815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:56.415653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 109/209] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:30:56.637769 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04722e-3884-4e03-aa11-c18cf2261a67 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:56.758285 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05485d8-b907-45f0-9553-ededce4bad4d None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:56.758926 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05485d8-b907-45f0-9553-ededce4bad4d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:56.759452 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05485d8-b907-45f0-9553-ededce4bad4d None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:56.771216 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 110/210] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:30:56.772966 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65bbb9-ef0f-462a-9426-1ea921b182af None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:56.773475 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65bbb9-ef0f-462a-9426-1ea921b182af None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:56.773953 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65bbb9-ef0f-462a-9426-1ea921b182af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:56.796008 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-cd65bbb9-ef0f-462a-9426-1ea921b182af None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:30:56.797541 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-cd65bbb9-ef0f-462a-9426-1ea921b182af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:30:56.802565 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04722e-3884-4e03-aa11-c18cf2261a67 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:56.824019 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:56.845802 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287eb4d-2629-47da-b71c-caddada014e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:56.846537 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287eb4d-2629-47da-b71c-caddada014e0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:56.846818 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287eb4d-2629-47da-b71c-caddada014e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:56.847086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287eb4d-2629-47da-b71c-caddada014e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:56.859482 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287eb4d-2629-47da-b71c-caddada014e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-4287eb4d-2629-47da-b71c-caddada014e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:56.866254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:56.867153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:56.868076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:56.868076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:56.868076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:56.868076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:56.868076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:56.868076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:56.868076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:56.868076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:56.868076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:56.868076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:56.868076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:30:56.868076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:56.868076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 101/211] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:56.868820 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287eb4d-2629-47da-b71c-caddada014e0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:56.904222 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 111/212] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:30:56.911560 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65bbb9-ef0f-462a-9426-1ea921b182af None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:57.010300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:57.014197 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287eb4d-2629-47da-b71c-caddada014e0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:57.034289 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65bbb9-ef0f-462a-9426-1ea921b182af None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:57.060292 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ea46f-2b0d-43e2-8511-03391260006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:57.061315 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ea46f-2b0d-43e2-8511-03391260006a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:57.061783 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ea46f-2b0d-43e2-8511-03391260006a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:57.062290 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ea46f-2b0d-43e2-8511-03391260006a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:57.063661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ea46f-2b0d-43e2-8511-03391260006a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:57.066440 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ea46f-2b0d-43e2-8511-03391260006a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:57.068710 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 102/213] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:30:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:57.073847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ea46f-2b0d-43e2-8511-03391260006a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:57.086634 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee6594-7290-421f-8050-cf9a8502012d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:57.087566 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee6594-7290-421f-8050-cf9a8502012d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:57.088015 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee6594-7290-421f-8050-cf9a8502012d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:57.088456 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee6594-7290-421f-8050-cf9a8502012d None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:57.089284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee6594-7290-421f-8050-cf9a8502012d None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:57.089757 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee6594-7290-421f-8050-cf9a8502012d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:57.091424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee6594-7290-421f-8050-cf9a8502012d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:57.101794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 112/214] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:30:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:57.107571 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee6594-7290-421f-8050-cf9a8502012d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:57.132675 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:57.205597 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ea46f-2b0d-43e2-8511-03391260006a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:57.249572 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9efb8c-ca95-49a7-bf90-a4d9f5b77722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:57.250181 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9efb8c-ca95-49a7-bf90-a4d9f5b77722 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:57.250452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9efb8c-ca95-49a7-bf90-a4d9f5b77722 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:57.250714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9efb8c-ca95-49a7-bf90-a4d9f5b77722 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:57.251382 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee6594-7290-421f-8050-cf9a8502012d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:57.252422 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9efb8c-ca95-49a7-bf90-a4d9f5b77722 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:57.253938 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9efb8c-ca95-49a7-bf90-a4d9f5b77722 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:57.276459 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 103/215] 10.222.0.40 () {60 vars in 1132 bytes} [Sat Oct 29 20:30:57 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 20:30:57.277788 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9efb8c-ca95-49a7-bf90-a4d9f5b77722 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:57.293250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646d89-968b-4422-b55b-326f03b8a6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:57.294020 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646d89-968b-4422-b55b-326f03b8a6f5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:57.294361 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646d89-968b-4422-b55b-326f03b8a6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:57.294699 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646d89-968b-4422-b55b-326f03b8a6f5 None admin] PATH_INFO: `/v3/users/efba196b30c14b929a60695c367391b7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:57.313492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05646d89-968b-4422-b55b-326f03b8a6f5 None admin] RBAC: Authorizing `identity:get_user(user_id=efba196b30c14b929a60695c367391b7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:57.316207 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05646d89-968b-4422-b55b-326f03b8a6f5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:57.318783 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 113/216] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:57 2022] GET /identity/v3/users/efba196b30c14b929a60695c367391b7 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:57.324449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646d89-968b-4422-b55b-326f03b8a6f5 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:57.334638 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:57.442006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:57.450836 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9efb8c-ca95-49a7-bf90-a4d9f5b77722 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:57.476623 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646d89-968b-4422-b55b-326f03b8a6f5 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:57.518017 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfa80f-5f3c-4b40-80fa-94e25d0ddd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:57.518746 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfa80f-5f3c-4b40-80fa-94e25d0ddd32 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:57.519101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfa80f-5f3c-4b40-80fa-94e25d0ddd32 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:57.519462 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfa80f-5f3c-4b40-80fa-94e25d0ddd32 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:57.536250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aff9d1-2da5-4aeb-a41c-9cd3695a3347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:57.536418 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfa80f-5f3c-4b40-80fa-94e25d0ddd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:30:57.537256 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aff9d1-2da5-4aeb-a41c-9cd3695a3347 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:57.538009 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aff9d1-2da5-4aeb-a41c-9cd3695a3347 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:57.538473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aff9d1-2da5-4aeb-a41c-9cd3695a3347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:57.539392 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aff9d1-2da5-4aeb-a41c-9cd3695a3347 None admin] RBAC: Adding query filter params (role.id=b2dae64b76124d298b982ee42347b223, user.id=efba196b30c14b929a60695c367391b7, scope.system=all) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:57.539852 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aff9d1-2da5-4aeb-a41c-9cd3695a3347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:57.541467 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aff9d1-2da5-4aeb-a41c-9cd3695a3347 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-3abfa80f-5f3c-4b40-80fa-94e25d0ddd32 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:30:57.545740 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:30:57.546957 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:30:57.547796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:30:57.547796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:30:57.547796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:30:57.547796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:30:57.547796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:30:57.547796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:30:57.547796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:30:57.547796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:30:57.547796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:30:57.547796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:30:57.547796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 20:30:57.547796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:30:57.547796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 104/217] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:30:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:30:57.551339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 114/218] 10.222.0.40 () {56 vars in 1308 bytes} [Sat Oct 29 20:30:57 2022] GET /identity/v3/role_assignments?user.id=efba196b30c14b929a60695c367391b7&scope.system=all&role.id=b2dae64b76124d298b982ee42347b223 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:57.558095 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfa80f-5f3c-4b40-80fa-94e25d0ddd32 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:57.725112 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfa80f-5f3c-4b40-80fa-94e25d0ddd32 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:57.764256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c99fa3-38a4-49a7-938b-888dddfc624a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:57.764879 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c99fa3-38a4-49a7-938b-888dddfc624a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:57.765152 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c99fa3-38a4-49a7-938b-888dddfc624a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:57.765418 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c99fa3-38a4-49a7-938b-888dddfc624a None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:57.766091 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c99fa3-38a4-49a7-938b-888dddfc624a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:57.766387 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c99fa3-38a4-49a7-938b-888dddfc624a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:57.768161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c99fa3-38a4-49a7-938b-888dddfc624a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:57.781594 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 105/219] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:30:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:57.788677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aff9d1-2da5-4aeb-a41c-9cd3695a3347 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:57.887422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:57.958287 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aff9d1-2da5-4aeb-a41c-9cd3695a3347 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:58.068948 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66013ea-7c49-4f34-9e24-d2b2b83e9102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:58.071226 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66013ea-7c49-4f34-9e24-d2b2b83e9102 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:58.072536 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66013ea-7c49-4f34-9e24-d2b2b83e9102 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:58.073377 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66013ea-7c49-4f34-9e24-d2b2b83e9102 None admin] PATH_INFO: `/v3/users/08a461efa9fc47b895d4b827fd5ed899` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:58.076203 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66013ea-7c49-4f34-9e24-d2b2b83e9102 None admin] RBAC: Authorizing `identity:get_user(user_id=08a461efa9fc47b895d4b827fd5ed899)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:58.078864 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66013ea-7c49-4f34-9e24-d2b2b83e9102 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:58.082068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 115/220] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:30:57 2022] GET /identity/v3/users/08a461efa9fc47b895d4b827fd5ed899 => generated 297 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:58.092445 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c99fa3-38a4-49a7-938b-888dddfc624a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:58.124421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:58.298778 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c99fa3-38a4-49a7-938b-888dddfc624a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:58.335224 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dcb60-29ba-414c-83a6-db74dde9b5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:58.336244 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dcb60-29ba-414c-83a6-db74dde9b5db None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:58.336668 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dcb60-29ba-414c-83a6-db74dde9b5db None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:58.337083 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dcb60-29ba-414c-83a6-db74dde9b5db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:58.406670 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862dcb60-29ba-414c-83a6-db74dde9b5db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:58.408978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862dcb60-29ba-414c-83a6-db74dde9b5db None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:58.449098 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:58.512137 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 106/221] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:30:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:30:58.521476 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66013ea-7c49-4f34-9e24-d2b2b83e9102 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:58.622320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66013ea-7c49-4f34-9e24-d2b2b83e9102 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:58.657681 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78259318-61eb-4b99-9626-f3f3ee2be621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:58.659165 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78259318-61eb-4b99-9626-f3f3ee2be621 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:58.659671 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78259318-61eb-4b99-9626-f3f3ee2be621 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:58.660139 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78259318-61eb-4b99-9626-f3f3ee2be621 None admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:58.661548 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78259318-61eb-4b99-9626-f3f3ee2be621 None admin] RBAC: Authorizing `identity:get_project(project_id=d2dc0b040d8141b9a5b8c2417b349712)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:58.663204 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78259318-61eb-4b99-9626-f3f3ee2be621 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:58.665342 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 116/222] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:30:58 2022] GET /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:30:58.671608 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dcb60-29ba-414c-83a6-db74dde9b5db None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:30:58.775735 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dcb60-29ba-414c-83a6-db74dde9b5db None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:30:58.801318 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:30:58.813932 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ec5ff-c536-49d9-9607-68120aa58e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:30:58.814906 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ec5ff-c536-49d9-9607-68120aa58e4b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:30:58.815495 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ec5ff-c536-49d9-9607-68120aa58e4b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:30:58.816018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ec5ff-c536-49d9-9607-68120aa58e4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:30:58.816990 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ec5ff-c536-49d9-9607-68120aa58e4b None admin] RBAC: Adding query filter params (role.id=ef7ddbd2f19b4d6295147f4a6591da72, scope.project.id=d2dc0b040d8141b9a5b8c2417b349712, user.id=08a461efa9fc47b895d4b827fd5ed899) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:30:58.817518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ec5ff-c536-49d9-9607-68120aa58e4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:30:58.819143 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ec5ff-c536-49d9-9607-68120aa58e4b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:30:58.827584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 107/223] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:30:58 2022] GET /identity/v3/role_assignments?user.id=08a461efa9fc47b895d4b827fd5ed899&scope.project.id=d2dc0b040d8141b9a5b8c2417b349712&role.id=ef7ddbd2f19b4d6295147f4a6591da72 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:00.016472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3fd46-64bf-4e43-92a9-6452719843b0 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:00.017033 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3fd46-64bf-4e43-92a9-6452719843b0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:00.017033 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3fd46-64bf-4e43-92a9-6452719843b0 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:00.018538 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 117/224] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:00.023869 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637cf04-bc17-4329-b026-13c52740564f None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:00.024270 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637cf04-bc17-4329-b026-13c52740564f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:00.024455 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637cf04-bc17-4329-b026-13c52740564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:00.043135 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c637cf04-bc17-4329-b026-13c52740564f None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:00.044340 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c637cf04-bc17-4329-b026-13c52740564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:00.060518 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793c49b-1ae9-4c6f-b5a5-76f148485b3f None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:00.060789 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793c49b-1ae9-4c6f-b5a5-76f148485b3f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:00.061059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793c49b-1ae9-4c6f-b5a5-76f148485b3f None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:00.062544 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 118/225] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:31:00.067922 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9ea71-d3ad-4265-861c-44dd28238d74 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:00.068372 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9ea71-d3ad-4265-861c-44dd28238d74 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:00.068640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9ea71-d3ad-4265-861c-44dd28238d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:00.074935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:00.088928 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c8e9ea71-d3ad-4265-861c-44dd28238d74 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:00.090129 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c8e9ea71-d3ad-4265-861c-44dd28238d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:00.119488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 108/226] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:00.162486 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 119/227] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:31:00.228268 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1690a2-8bb0-44ec-9478-db1d314c7d27 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:00.228608 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1690a2-8bb0-44ec-9478-db1d314c7d27 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:00.228828 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1690a2-8bb0-44ec-9478-db1d314c7d27 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:00.230291 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 109/228] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:00.235259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf5b3-bc9f-4b7d-90f9-4c447661dc7d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:00.235577 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf5b3-bc9f-4b7d-90f9-4c447661dc7d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:00.235876 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf5b3-bc9f-4b7d-90f9-4c447661dc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:00.258397 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6edaf5b3-bc9f-4b7d-90f9-4c447661dc7d None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:00.258397 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6edaf5b3-bc9f-4b7d-90f9-4c447661dc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:00.327473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 120/229] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:00.446626 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1690a2-8bb0-44ec-9478-db1d314c7d27 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:00.485320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaf5b3-bc9f-4b7d-90f9-4c447661dc7d None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:00.552313 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:00.555856 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1690a2-8bb0-44ec-9478-db1d314c7d27 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:00.573329 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:00.593787 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaf5b3-bc9f-4b7d-90f9-4c447661dc7d None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:00.594153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b46850-db43-4874-a6e5-c394b401f0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:00.594774 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b46850-db43-4874-a6e5-c394b401f0ee None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:00.595164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b46850-db43-4874-a6e5-c394b401f0ee None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:00.595576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b46850-db43-4874-a6e5-c394b401f0ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:00.606439 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b46850-db43-4874-a6e5-c394b401f0ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b9b46850-db43-4874-a6e5-c394b401f0ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:00.613218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:00.614105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:00.614900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:00.614900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:00.614900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:00.614900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:00.614900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:00.614900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:00.614900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:00.614900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:00.614900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:00.614900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:00.614900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 20:31:00.614900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:00.614900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 110/230] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:31:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:00.620403 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b46850-db43-4874-a6e5-c394b401f0ee None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:00.630900 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4906c-2954-434f-aacb-9340d35f14a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:00.631935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4906c-2954-434f-aacb-9340d35f14a4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:00.632216 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4906c-2954-434f-aacb-9340d35f14a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:00.632489 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4906c-2954-434f-aacb-9340d35f14a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:00.646092 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4906c-2954-434f-aacb-9340d35f14a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-75a4906c-2954-434f-aacb-9340d35f14a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:00.651042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:00.652158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:00.653070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:00.653070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:00.653070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:00.653070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:00.653070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:00.653070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:00.653070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:00.653070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:00.653070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:00.653070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:00.653070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:31:00.653070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:00.653070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 121/231] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:31:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:31:00.653070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4906c-2954-434f-aacb-9340d35f14a4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:00.723138 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b46850-db43-4874-a6e5-c394b401f0ee None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:00.750907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4906c-2954-434f-aacb-9340d35f14a4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:00.756992 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fde31-00c5-4ece-b0f2-4f6b28015d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:00.757590 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fde31-00c5-4ece-b0f2-4f6b28015d74 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:00.757866 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fde31-00c5-4ece-b0f2-4f6b28015d74 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:00.758132 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fde31-00c5-4ece-b0f2-4f6b28015d74 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:00.758789 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fde31-00c5-4ece-b0f2-4f6b28015d74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:00.759089 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fde31-00c5-4ece-b0f2-4f6b28015d74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:00.760541 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fde31-00c5-4ece-b0f2-4f6b28015d74 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:00.768982 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 111/232] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:31:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:00.769577 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fde31-00c5-4ece-b0f2-4f6b28015d74 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:00.778938 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:00.793188 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773104b-80b8-4e36-ad93-81216c0eecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:00.793825 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773104b-80b8-4e36-ad93-81216c0eecde None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:00.794101 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773104b-80b8-4e36-ad93-81216c0eecde None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:00.794372 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773104b-80b8-4e36-ad93-81216c0eecde None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:00.795508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773104b-80b8-4e36-ad93-81216c0eecde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:00.797234 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773104b-80b8-4e36-ad93-81216c0eecde None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:00.798897 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 122/233] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:00.799790 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773104b-80b8-4e36-ad93-81216c0eecde None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:00.810872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:00.870742 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fde31-00c5-4ece-b0f2-4f6b28015d74 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:00.903511 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773104b-80b8-4e36-ad93-81216c0eecde None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:00.904889 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b030071-576d-4102-aaed-585c1149211d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:00.905491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b030071-576d-4102-aaed-585c1149211d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:00.905767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b030071-576d-4102-aaed-585c1149211d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:00.906029 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b030071-576d-4102-aaed-585c1149211d None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:00.906681 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b030071-576d-4102-aaed-585c1149211d None admin] RBAC: Adding query filter params (name=member) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:00.906980 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b030071-576d-4102-aaed-585c1149211d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:00.908430 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b030071-576d-4102-aaed-585c1149211d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:00.917168 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 112/234] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:31:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:00.918136 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b030071-576d-4102-aaed-585c1149211d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:00.943408 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ab511-6deb-4cc8-af16-0450d3a0b8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:00.944041 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ab511-6deb-4cc8-af16-0450d3a0b8ed None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:00.944323 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ab511-6deb-4cc8-af16-0450d3a0b8ed None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:00.944596 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ab511-6deb-4cc8-af16-0450d3a0b8ed None admin] PATH_INFO: `/v3/users/f92f12e11e534b4bb911f7a8f64e8bf1` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:00.959558 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ab511-6deb-4cc8-af16-0450d3a0b8ed None admin] RBAC: Authorizing `identity:get_user(user_id=f92f12e11e534b4bb911f7a8f64e8bf1)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:00.961024 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ab511-6deb-4cc8-af16-0450d3a0b8ed None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:00.962647 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 123/235] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:31:00 2022] GET /identity/v3/users/f92f12e11e534b4bb911f7a8f64e8bf1 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:00.963428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ab511-6deb-4cc8-af16-0450d3a0b8ed None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:01.012791 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:01.017224 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:01.021080 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b030071-576d-4102-aaed-585c1149211d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:01.054406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b5fb-b052-4f56-9f01-7cd0895b8680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:01.055038 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b5fb-b052-4f56-9f01-7cd0895b8680 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:01.055259 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b5fb-b052-4f56-9f01-7cd0895b8680 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:01.055558 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b5fb-b052-4f56-9f01-7cd0895b8680 None admin] PATH_INFO: `/v3/groups` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:01.056184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41b5fb-b052-4f56-9f01-7cd0895b8680 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:01.057627 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41b5fb-b052-4f56-9f01-7cd0895b8680 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:01.066010 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ab511-6deb-4cc8-af16-0450d3a0b8ed None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:01.073695 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 113/236] 10.222.0.40 () {60 vars in 1134 bytes} [Sat Oct 29 20:31:00 2022] POST /identity/v3/groups => generated 229 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:31:01.074491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b5fb-b052-4f56-9f01-7cd0895b8680 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:01.104423 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575f7c5-abf2-4338-8cca-0cc39129d472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:01.105183 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575f7c5-abf2-4338-8cca-0cc39129d472 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:01.105540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575f7c5-abf2-4338-8cca-0cc39129d472 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:01.105885 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575f7c5-abf2-4338-8cca-0cc39129d472 None admin] PATH_INFO: `/v3/users/efba196b30c14b929a60695c367391b7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:01.107225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575f7c5-abf2-4338-8cca-0cc39129d472 None admin] RBAC: Authorizing `identity:get_user(user_id=efba196b30c14b929a60695c367391b7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:01.108763 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575f7c5-abf2-4338-8cca-0cc39129d472 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:01.110618 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 124/237] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:31:00 2022] GET /identity/v3/users/efba196b30c14b929a60695c367391b7 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:01.120554 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575f7c5-abf2-4338-8cca-0cc39129d472 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:01.193260 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b5fb-b052-4f56-9f01-7cd0895b8680 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:01.230333 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f531e-f5be-4dbc-b0e0-f96c60fbfd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:01.230950 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f531e-f5be-4dbc-b0e0-f96c60fbfd80 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:01.231223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f531e-f5be-4dbc-b0e0-f96c60fbfd80 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:01.231516 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f531e-f5be-4dbc-b0e0-f96c60fbfd80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:01.232257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f531e-f5be-4dbc-b0e0-f96c60fbfd80 None admin] RBAC: Adding query filter params (role.id=ef7ddbd2f19b4d6295147f4a6591da72, user.id=f92f12e11e534b4bb911f7a8f64e8bf1, scope.system=all) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:01.232557 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f531e-f5be-4dbc-b0e0-f96c60fbfd80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:01.234028 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f531e-f5be-4dbc-b0e0-f96c60fbfd80 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:01.241533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 114/238] 10.222.0.40 () {56 vars in 1308 bytes} [Sat Oct 29 20:31:01 2022] GET /identity/v3/role_assignments?user.id=f92f12e11e534b4bb911f7a8f64e8bf1&scope.system=all&role.id=ef7ddbd2f19b4d6295147f4a6591da72 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:01.248216 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575f7c5-abf2-4338-8cca-0cc39129d472 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:01.273100 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:01.296602 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbea63-54b8-44df-9318-c71dd710f82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:01.297272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbea63-54b8-44df-9318-c71dd710f82f None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:01.297548 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbea63-54b8-44df-9318-c71dd710f82f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:01.297820 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbea63-54b8-44df-9318-c71dd710f82f None admin] PATH_INFO: `/v3/system/users/efba196b30c14b929a60695c367391b7/roles/b2dae64b76124d298b982ee42347b223` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:01.300069 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbea63-54b8-44df-9318-c71dd710f82f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=efba196b30c14b929a60695c367391b7, role_id=b2dae64b76124d298b982ee42347b223)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:01.301610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbea63-54b8-44df-9318-c71dd710f82f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:01.311939 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 125/239] 10.222.0.40 () {58 vars in 1334 bytes} [Sat Oct 29 20:31:01 2022] PUT /identity/v3/system/users/efba196b30c14b929a60695c367391b7/roles/b2dae64b76124d298b982ee42347b223 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:31:03.610074 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e857d6-be1d-4635-968a-58b11dffa71c None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:03.610562 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e857d6-be1d-4635-968a-58b11dffa71c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:03.610562 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e857d6-be1d-4635-968a-58b11dffa71c None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:03.613045 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 115/240] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:03.618213 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955cb7c-7861-48cf-a319-cedbc3f93a10 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:03.618601 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955cb7c-7861-48cf-a319-cedbc3f93a10 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:03.618777 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955cb7c-7861-48cf-a319-cedbc3f93a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:03.637765 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9955cb7c-7861-48cf-a319-cedbc3f93a10 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:03.638954 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9955cb7c-7861-48cf-a319-cedbc3f93a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:03.644863 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fe84a-c75e-41b3-9c43-0fc47b957d91 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:03.645144 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fe84a-c75e-41b3-9c43-0fc47b957d91 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:03.645416 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fe84a-c75e-41b3-9c43-0fc47b957d91 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:03.646862 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 116/241] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:31:03.652230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978329e-1c87-457b-ac91-2d5a18623d1e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:03.652525 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978329e-1c87-457b-ac91-2d5a18623d1e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:03.652798 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978329e-1c87-457b-ac91-2d5a18623d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:03.672454 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c978329e-1c87-457b-ac91-2d5a18623d1e None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:03.674493 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c978329e-1c87-457b-ac91-2d5a18623d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:03.693685 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:03.715456 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 126/242] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:03.736640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97096f45-adfd-4087-9549-2332fe795c4b None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:03.736910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97096f45-adfd-4087-9549-2332fe795c4b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:03.737188 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97096f45-adfd-4087-9549-2332fe795c4b None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:03.738547 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 127/243] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:31:03.743994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba1b2b-e34d-48ae-a454-e850fc90e941 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:03.744425 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba1b2b-e34d-48ae-a454-e850fc90e941 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:03.744680 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba1b2b-e34d-48ae-a454-e850fc90e941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:03.748971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 117/244] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:03.766263 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c7ba1b2b-e34d-48ae-a454-e850fc90e941 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:03.767561 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c7ba1b2b-e34d-48ae-a454-e850fc90e941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:03.844879 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 128/245] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:31:04.050247 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978329e-1c87-457b-ac91-2d5a18623d1e None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:04.072433 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba1b2b-e34d-48ae-a454-e850fc90e941 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:04.115510 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:04.162384 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978329e-1c87-457b-ac91-2d5a18623d1e None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:04.179045 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba1b2b-e34d-48ae-a454-e850fc90e941 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:04.197313 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee9f15-b390-4d05-b5f9-f29a4e47ac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:04.197940 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee9f15-b390-4d05-b5f9-f29a4e47ac31 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:04.198214 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee9f15-b390-4d05-b5f9-f29a4e47ac31 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:04.198482 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee9f15-b390-4d05-b5f9-f29a4e47ac31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:04.199600 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee9f15-b390-4d05-b5f9-f29a4e47ac31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:04.201105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee9f15-b390-4d05-b5f9-f29a4e47ac31 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:04.202687 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 118/246] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:04.208587 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee9f15-b390-4d05-b5f9-f29a4e47ac31 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:04.213877 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14452a90-8fb7-4de8-a16c-d73193536f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:04.214504 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14452a90-8fb7-4de8-a16c-d73193536f39 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:04.214777 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14452a90-8fb7-4de8-a16c-d73193536f39 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:04.215042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14452a90-8fb7-4de8-a16c-d73193536f39 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:04.226762 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14452a90-8fb7-4de8-a16c-d73193536f39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-14452a90-8fb7-4de8-a16c-d73193536f39 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:04.231871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:04.232845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:04.233610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:04.233610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:04.233610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:04.233610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:04.233610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:04.233610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:04.233610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:04.233610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:04.233610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:04.233610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:04.233610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 20:31:04.233610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:04.234192 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:04.234259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 129/247] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:31:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:31:04.234259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14452a90-8fb7-4de8-a16c-d73193536f39 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:04.311602 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee9f15-b390-4d05-b5f9-f29a4e47ac31 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:04.334457 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:04.337662 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14452a90-8fb7-4de8-a16c-d73193536f39 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:04.346577 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3841e7d-468b-4a5c-8311-3ee8d62e8a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:04.347189 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3841e7d-468b-4a5c-8311-3ee8d62e8a4e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:04.347490 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3841e7d-468b-4a5c-8311-3ee8d62e8a4e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:04.347760 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3841e7d-468b-4a5c-8311-3ee8d62e8a4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:04.357717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3841e7d-468b-4a5c-8311-3ee8d62e8a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-e3841e7d-468b-4a5c-8311-3ee8d62e8a4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:04.363018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:04.364076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:04.364999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:04.364999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:04.364999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:04.364999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:04.364999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:04.364999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:04.364999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:04.364999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:04.364999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:04.364999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:04.364999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:31:04.364999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:04.364999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 119/248] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:31:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:04.364999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3841e7d-468b-4a5c-8311-3ee8d62e8a4e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:04.377233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a61730-5c2b-4b33-891c-91cb828bd560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:04.377845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a61730-5c2b-4b33-891c-91cb828bd560 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:04.378119 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a61730-5c2b-4b33-891c-91cb828bd560 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:04.378387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a61730-5c2b-4b33-891c-91cb828bd560 None admin] PATH_INFO: `/v3/groups` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:04.379009 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a61730-5c2b-4b33-891c-91cb828bd560 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:04.380638 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a61730-5c2b-4b33-891c-91cb828bd560 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:04.397339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 130/249] 10.222.0.40 () {60 vars in 1134 bytes} [Sat Oct 29 20:31:04 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:31:04.398140 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a61730-5c2b-4b33-891c-91cb828bd560 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:04.460631 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:04.483528 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3841e7d-468b-4a5c-8311-3ee8d62e8a4e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:04.522036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a61730-5c2b-4b33-891c-91cb828bd560 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:04.524273 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b72df-46a9-4e00-8c2a-12e39baef7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:04.525098 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b72df-46a9-4e00-8c2a-12e39baef7f0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:04.525374 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b72df-46a9-4e00-8c2a-12e39baef7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:04.525646 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b72df-46a9-4e00-8c2a-12e39baef7f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:04.526323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b72df-46a9-4e00-8c2a-12e39baef7f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:04.526621 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b72df-46a9-4e00-8c2a-12e39baef7f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:04.528051 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b72df-46a9-4e00-8c2a-12e39baef7f0 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:04.537477 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 120/250] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:31:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:04.543143 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b72df-46a9-4e00-8c2a-12e39baef7f0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:04.560595 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa1157-9cc7-4d20-9e1e-e183d46857d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:04.561226 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa1157-9cc7-4d20-9e1e-e183d46857d2 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:04.561508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa1157-9cc7-4d20-9e1e-e183d46857d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:04.561845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa1157-9cc7-4d20-9e1e-e183d46857d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:04.562482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa1157-9cc7-4d20-9e1e-e183d46857d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:04.562786 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa1157-9cc7-4d20-9e1e-e183d46857d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:04.564814 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa1157-9cc7-4d20-9e1e-e183d46857d2 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:04.574483 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 131/251] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:31:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:04.581102 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa1157-9cc7-4d20-9e1e-e183d46857d2 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:04.608298 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:04.667922 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b72df-46a9-4e00-8c2a-12e39baef7f0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:04.698462 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa1157-9cc7-4d20-9e1e-e183d46857d2 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:04.714757 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0ff65-122a-4694-b309-fa00f2be56bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:04.716573 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0ff65-122a-4694-b309-fa00f2be56bc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:04.716954 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0ff65-122a-4694-b309-fa00f2be56bc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:04.717192 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0ff65-122a-4694-b309-fa00f2be56bc None admin] PATH_INFO: `/v3/users/f92f12e11e534b4bb911f7a8f64e8bf1` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:04.718277 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0ff65-122a-4694-b309-fa00f2be56bc None admin] RBAC: Authorizing `identity:get_user(user_id=f92f12e11e534b4bb911f7a8f64e8bf1)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:04.719868 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0ff65-122a-4694-b309-fa00f2be56bc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:04.722663 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 121/252] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:31:04 2022] GET /identity/v3/users/f92f12e11e534b4bb911f7a8f64e8bf1 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:04.729049 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0ff65-122a-4694-b309-fa00f2be56bc None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:04.747187 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c15a1-94c8-4993-b67c-e496fdeed985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:04.747853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:04.747969 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c15a1-94c8-4993-b67c-e496fdeed985 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:04.748224 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c15a1-94c8-4993-b67c-e496fdeed985 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:04.748400 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c15a1-94c8-4993-b67c-e496fdeed985 None admin] PATH_INFO: `/v3/users/efba196b30c14b929a60695c367391b7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:04.749540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c15a1-94c8-4993-b67c-e496fdeed985 None admin] RBAC: Authorizing `identity:get_user(user_id=efba196b30c14b929a60695c367391b7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:04.750991 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c15a1-94c8-4993-b67c-e496fdeed985 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:04.754012 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 132/253] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:31:04 2022] GET /identity/v3/users/efba196b30c14b929a60695c367391b7 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:04.759582 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c15a1-94c8-4993-b67c-e496fdeed985 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:04.870672 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0ff65-122a-4694-b309-fa00f2be56bc None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:04.877374 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:04.899280 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c15a1-94c8-4993-b67c-e496fdeed985 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:04.922099 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f2a60-4a99-44a7-8e39-a56597fe8f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:04.922762 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f2a60-4a99-44a7-8e39-a56597fe8f96 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:04.923040 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f2a60-4a99-44a7-8e39-a56597fe8f96 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:04.923364 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f2a60-4a99-44a7-8e39-a56597fe8f96 None admin] PATH_INFO: `/v3/system/users/f92f12e11e534b4bb911f7a8f64e8bf1/roles/ef7ddbd2f19b4d6295147f4a6591da72` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:04.926131 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f2a60-4a99-44a7-8e39-a56597fe8f96 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f92f12e11e534b4bb911f7a8f64e8bf1, role_id=ef7ddbd2f19b4d6295147f4a6591da72)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:04.927893 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f2a60-4a99-44a7-8e39-a56597fe8f96 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:04.940240 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 122/254] 10.222.0.40 () {58 vars in 1334 bytes} [Sat Oct 29 20:31:04 2022] PUT /identity/v3/system/users/f92f12e11e534b4bb911f7a8f64e8bf1/roles/ef7ddbd2f19b4d6295147f4a6591da72 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:31:04.945693 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f2f34-0c32-4b53-875d-f1cb88132fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:04.946746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f2f34-0c32-4b53-875d-f1cb88132fd1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:04.947222 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f2f34-0c32-4b53-875d-f1cb88132fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:04.947736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f2f34-0c32-4b53-875d-f1cb88132fd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:04.948768 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f2f34-0c32-4b53-875d-f1cb88132fd1 None admin] RBAC: Adding query filter params (role.id=b2dae64b76124d298b982ee42347b223, user.id=efba196b30c14b929a60695c367391b7, scope.system=all) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:04.949286 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f2f34-0c32-4b53-875d-f1cb88132fd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:04.951203 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f2f34-0c32-4b53-875d-f1cb88132fd1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:04.967970 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 133/255] 10.222.0.40 () {56 vars in 1308 bytes} [Sat Oct 29 20:31:04 2022] GET /identity/v3/role_assignments?user.id=efba196b30c14b929a60695c367391b7&scope.system=all&role.id=b2dae64b76124d298b982ee42347b223 => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:07.142920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2f5f2-6f9d-418b-bf2d-25c0a722ed86 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:07.143711 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2f5f2-6f9d-418b-bf2d-25c0a722ed86 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:07.143711 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2f5f2-6f9d-418b-bf2d-25c0a722ed86 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:07.145315 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 123/256] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:07.150619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc492e-aa77-4c69-b2ba-6653076bab78 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:07.151060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc492e-aa77-4c69-b2ba-6653076bab78 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:07.151237 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc492e-aa77-4c69-b2ba-6653076bab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:07.178705 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-65bc492e-aa77-4c69-b2ba-6653076bab78 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:07.179972 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-65bc492e-aa77-4c69-b2ba-6653076bab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:07.283429 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 134/257] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 29 20:31:07.475744 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ab839-1933-4dc0-bd20-12959061063d None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:07.476396 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ab839-1933-4dc0-bd20-12959061063d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:07.476950 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ab839-1933-4dc0-bd20-12959061063d None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:07.478518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 124/258] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:07.483998 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed0090-598d-438d-8e03-4cac033872f2 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:07.484526 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed0090-598d-438d-8e03-4cac033872f2 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:07.484978 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed0090-598d-438d-8e03-4cac033872f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:07.508318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-36ed0090-598d-438d-8e03-4cac033872f2 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:07.509803 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-36ed0090-598d-438d-8e03-4cac033872f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:07.520277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 135/259] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 29 20:31:07.655017 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ab839-1933-4dc0-bd20-12959061063d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:07.675526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ab839-1933-4dc0-bd20-12959061063d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:07.685266 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203a071-26fd-4568-95bf-a26cbe1f3022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:07.686270 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203a071-26fd-4568-95bf-a26cbe1f3022 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:07.686753 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203a071-26fd-4568-95bf-a26cbe1f3022 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:07.687225 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203a071-26fd-4568-95bf-a26cbe1f3022 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:07.704517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203a071-26fd-4568-95bf-a26cbe1f3022 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-1203a071-26fd-4568-95bf-a26cbe1f3022 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:07.710394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:07.711316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:07.712149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:07.712149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:07.712149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:07.712149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:07.712149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:07.712149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:07.712149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:07.712149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:07.712149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:07.712149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:07.712149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:31:07.712149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:07.715872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 125/260] 10.222.0.40 () {56 vars in 1120 bytes} [Sat Oct 29 20:31:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:07.721292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed0090-598d-438d-8e03-4cac033872f2 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:07.731757 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed0090-598d-438d-8e03-4cac033872f2 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:07.739326 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11bfee-9c14-4d93-b527-4c7feaaefe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:07.740275 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11bfee-9c14-4d93-b527-4c7feaaefe49 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:07.740763 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11bfee-9c14-4d93-b527-4c7feaaefe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:07.741239 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11bfee-9c14-4d93-b527-4c7feaaefe49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:07.742125 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11bfee-9c14-4d93-b527-4c7feaaefe49 admin admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:07.742631 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11bfee-9c14-4d93-b527-4c7feaaefe49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:07.744651 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: WARNING py.warnings [None req-7a11bfee-9c14-4d93-b527-4c7feaaefe49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:31:07.744651 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: warnings.warn(msg) Oct 29 20:31:07.744651 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: Oct 29 20:31:07.745954 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11bfee-9c14-4d93-b527-4c7feaaefe49 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:07.761330 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 136/261] 10.222.0.40 () {56 vars in 1122 bytes} [Sat Oct 29 20:31:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:07.767996 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203a071-26fd-4568-95bf-a26cbe1f3022 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:07.779705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203a071-26fd-4568-95bf-a26cbe1f3022 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:07.788910 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3e182-914a-4e10-969e-f8f3280d48b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:07.789907 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3e182-914a-4e10-969e-f8f3280d48b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:07.790453 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3e182-914a-4e10-969e-f8f3280d48b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:07.790996 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3e182-914a-4e10-969e-f8f3280d48b7 admin admin] PATH_INFO: `/v3/groups/92e99d4a3298457abdce45af647781e1` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:07.805083 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3e182-914a-4e10-969e-f8f3280d48b7 admin admin] RBAC: Authorizing `identity:get_group(group_id=92e99d4a3298457abdce45af647781e1)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:07.807237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: WARNING py.warnings [None req-3af3e182-914a-4e10-969e-f8f3280d48b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:31:07.807237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: warnings.warn(msg) Oct 29 20:31:07.807237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: Oct 29 20:31:07.808873 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3e182-914a-4e10-969e-f8f3280d48b7 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:07.811181 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 126/262] 10.222.0.40 () {56 vars in 1201 bytes} [Sat Oct 29 20:31:07 2022] GET /identity/v3/groups/92e99d4a3298457abdce45af647781e1 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:07.817159 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11bfee-9c14-4d93-b527-4c7feaaefe49 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:07.827880 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11bfee-9c14-4d93-b527-4c7feaaefe49 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:07.838508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29662c-9e9d-4d0e-b19f-0e1e7483b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:07.839537 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29662c-9e9d-4d0e-b19f-0e1e7483b8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:07.840028 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29662c-9e9d-4d0e-b19f-0e1e7483b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:07.840513 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29662c-9e9d-4d0e-b19f-0e1e7483b8a5 admin admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:07.841873 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29662c-9e9d-4d0e-b19f-0e1e7483b8a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=6c41b3079f3f49db85d760bd5ef1f568)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:07.844240 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29662c-9e9d-4d0e-b19f-0e1e7483b8a5 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:07.847683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 137/263] 10.222.0.40 () {56 vars in 1207 bytes} [Sat Oct 29 20:31:07 2022] GET /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:07.852746 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3e182-914a-4e10-969e-f8f3280d48b7 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:07.867106 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3e182-914a-4e10-969e-f8f3280d48b7 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:07.877132 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420bcf-a71e-4372-a8c7-79f43c008973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:07.878244 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420bcf-a71e-4372-a8c7-79f43c008973 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:07.878749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420bcf-a71e-4372-a8c7-79f43c008973 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:07.879226 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420bcf-a71e-4372-a8c7-79f43c008973 admin admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568/groups/92e99d4a3298457abdce45af647781e1/roles/b2dae64b76124d298b982ee42347b223` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:07.881398 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82420bcf-a71e-4372-a8c7-79f43c008973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c41b3079f3f49db85d760bd5ef1f568, group_id=92e99d4a3298457abdce45af647781e1, role_id=b2dae64b76124d298b982ee42347b223)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:07.882630 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: WARNING py.warnings [None req-82420bcf-a71e-4372-a8c7-79f43c008973 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:31:07.882630 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: warnings.warn(msg) Oct 29 20:31:07.882630 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: Oct 29 20:31:07.884988 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82420bcf-a71e-4372-a8c7-79f43c008973 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:07.917749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 127/264] 10.222.0.40 () {58 vars in 1463 bytes} [Sat Oct 29 20:31:07 2022] PUT /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568/groups/92e99d4a3298457abdce45af647781e1/roles/b2dae64b76124d298b982ee42347b223 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:31:08.229472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29662c-9e9d-4d0e-b19f-0e1e7483b8a5 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:08.246052 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29662c-9e9d-4d0e-b19f-0e1e7483b8a5 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:08.331091 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c7233-cfd6-4e0e-bb93-ce2bd7a0c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:08.332233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c7233-cfd6-4e0e-bb93-ce2bd7a0c8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:08.332738 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c7233-cfd6-4e0e-bb93-ce2bd7a0c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:08.333223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c7233-cfd6-4e0e-bb93-ce2bd7a0c8c8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:08.346905 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c7233-cfd6-4e0e-bb93-ce2bd7a0c8c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-c19c7233-cfd6-4e0e-bb93-ce2bd7a0c8c8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:08.352907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:08.353805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:08.354584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:08.354584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:08.354584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:08.354584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:08.354584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:08.354584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:08.354584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:08.354584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:08.354584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:08.354584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:08.354584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:31:08.354584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:08.356919 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 138/265] 10.222.0.40 () {56 vars in 1135 bytes} [Sat Oct 29 20:31:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:08.362868 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420bcf-a71e-4372-a8c7-79f43c008973 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:08.383806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420bcf-a71e-4372-a8c7-79f43c008973 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:08.389497 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc8bea-69b0-443b-a62e-3063a4355222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:08.390114 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc8bea-69b0-443b-a62e-3063a4355222 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:08.390392 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc8bea-69b0-443b-a62e-3063a4355222 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:08.390662 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc8bea-69b0-443b-a62e-3063a4355222 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:08.391389 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc8bea-69b0-443b-a62e-3063a4355222 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:08.391698 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc8bea-69b0-443b-a62e-3063a4355222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:08.392997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: WARNING py.warnings [None req-f8dc8bea-69b0-443b-a62e-3063a4355222 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:31:08.392997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: warnings.warn(msg) Oct 29 20:31:08.392997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: Oct 29 20:31:08.393876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc8bea-69b0-443b-a62e-3063a4355222 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:08.407317 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 128/266] 10.222.0.40 () {56 vars in 1132 bytes} [Sat Oct 29 20:31:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:08.413274 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c7233-cfd6-4e0e-bb93-ce2bd7a0c8c8 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:08.429891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c7233-cfd6-4e0e-bb93-ce2bd7a0c8c8 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:08.441917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b8e2-60ff-4ee1-ab75-686e65236818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:08.442998 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b8e2-60ff-4ee1-ab75-686e65236818 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:08.443508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b8e2-60ff-4ee1-ab75-686e65236818 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:08.444049 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b8e2-60ff-4ee1-ab75-686e65236818 admin admin] PATH_INFO: `/v3/groups/92e99d4a3298457abdce45af647781e1` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:08.448028 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5b8e2-60ff-4ee1-ab75-686e65236818 admin admin] RBAC: Authorizing `identity:get_group(group_id=92e99d4a3298457abdce45af647781e1)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:08.449319 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: WARNING py.warnings [None req-a3d5b8e2-60ff-4ee1-ab75-686e65236818 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:31:08.449319 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: warnings.warn(msg) Oct 29 20:31:08.449319 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: Oct 29 20:31:08.450899 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5b8e2-60ff-4ee1-ab75-686e65236818 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:08.452889 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 139/267] 10.222.0.40 () {56 vars in 1201 bytes} [Sat Oct 29 20:31:08 2022] GET /identity/v3/groups/92e99d4a3298457abdce45af647781e1 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:08.459256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc8bea-69b0-443b-a62e-3063a4355222 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:08.473347 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc8bea-69b0-443b-a62e-3063a4355222 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:08.482706 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe37edf-7763-4b22-914e-267301c9cb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:08.483278 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe37edf-7763-4b22-914e-267301c9cb7c admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:08.483577 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe37edf-7763-4b22-914e-267301c9cb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:08.483847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe37edf-7763-4b22-914e-267301c9cb7c admin admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:08.488389 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe37edf-7763-4b22-914e-267301c9cb7c admin admin] RBAC: Authorizing `identity:get_project(project_id=6c41b3079f3f49db85d760bd5ef1f568)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:08.490160 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe37edf-7763-4b22-914e-267301c9cb7c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:08.492174 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 129/268] 10.222.0.40 () {56 vars in 1207 bytes} [Sat Oct 29 20:31:08 2022] GET /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:08.497679 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b8e2-60ff-4ee1-ab75-686e65236818 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:08.509156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b8e2-60ff-4ee1-ab75-686e65236818 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:08.510721 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f0068-a818-4beb-8645-e5719c0e1173 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:08.511002 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f0068-a818-4beb-8645-e5719c0e1173 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:08.511281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f0068-a818-4beb-8645-e5719c0e1173 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:08.516677 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 130/269] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:08.518476 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74313bd7-359e-48b0-9abf-949ea1cd09eb None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:08.518759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74313bd7-359e-48b0-9abf-949ea1cd09eb None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:08.519034 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74313bd7-359e-48b0-9abf-949ea1cd09eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:08.520081 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f9638-5682-4b6e-9a2a-bd45b586a73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:08.520980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f9638-5682-4b6e-9a2a-bd45b586a73c admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:08.521465 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f9638-5682-4b6e-9a2a-bd45b586a73c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:08.521928 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f9638-5682-4b6e-9a2a-bd45b586a73c admin admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568/groups/92e99d4a3298457abdce45af647781e1/roles/d6c014b407594f248f451d331253c8a6` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:08.525193 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f9638-5682-4b6e-9a2a-bd45b586a73c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c41b3079f3f49db85d760bd5ef1f568, group_id=92e99d4a3298457abdce45af647781e1, role_id=d6c014b407594f248f451d331253c8a6)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:08.526236 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: WARNING py.warnings [None req-187f9638-5682-4b6e-9a2a-bd45b586a73c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:31:08.526236 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: warnings.warn(msg) Oct 29 20:31:08.526236 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: Oct 29 20:31:08.528260 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f9638-5682-4b6e-9a2a-bd45b586a73c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:08.545830 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-74313bd7-359e-48b0-9abf-949ea1cd09eb None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:08.547571 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-74313bd7-359e-48b0-9abf-949ea1cd09eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:08.548822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:08.555391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 140/270] 10.222.0.40 () {58 vars in 1463 bytes} [Sat Oct 29 20:31:08 2022] PUT /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568/groups/92e99d4a3298457abdce45af647781e1/roles/d6c014b407594f248f451d331253c8a6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:31:08.587211 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:08.648834 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 131/271] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:31:09.141196 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fd367-5374-435d-b24a-af29d90a234b None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:09.141562 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fd367-5374-435d-b24a-af29d90a234b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:09.141739 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fd367-5374-435d-b24a-af29d90a234b None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:09.143581 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 141/272] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:09.148747 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c177d2d-890e-4513-b20e-1e4ad3baf690 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:09.149282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c177d2d-890e-4513-b20e-1e4ad3baf690 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:09.149796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c177d2d-890e-4513-b20e-1e4ad3baf690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:09.180341 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0c177d2d-890e-4513-b20e-1e4ad3baf690 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:09.181545 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0c177d2d-890e-4513-b20e-1e4ad3baf690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:09.226882 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fd367-5374-435d-b24a-af29d90a234b None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:09.285796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 132/273] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 29 20:31:09.412013 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fd367-5374-435d-b24a-af29d90a234b None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:09.451639 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a01dc4-b5ec-4a46-b0c0-0226f4ff4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:09.452278 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a01dc4-b5ec-4a46-b0c0-0226f4ff4fac None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:09.452551 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a01dc4-b5ec-4a46-b0c0-0226f4ff4fac None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:09.452826 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a01dc4-b5ec-4a46-b0c0-0226f4ff4fac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:09.468165 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a01dc4-b5ec-4a46-b0c0-0226f4ff4fac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-39a01dc4-b5ec-4a46-b0c0-0226f4ff4fac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:09.473343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:09.474301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:09.475733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:09.475733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:09.475733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:09.475733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:09.475733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:09.475733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:09.475733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:09.475733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:09.475733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:09.475733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:09.475733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 20:31:09.475733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:09.475733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 142/274] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:31:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:31:09.480597 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c177d2d-890e-4513-b20e-1e4ad3baf690 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:09.602144 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752f6fc-b66e-4866-a8f3-e31dc5801127 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:09.602463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752f6fc-b66e-4866-a8f3-e31dc5801127 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:09.602701 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752f6fc-b66e-4866-a8f3-e31dc5801127 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:09.604083 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 143/275] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:09.609265 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f3910-e92c-4c67-8add-6b20bbc4678a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:09.609548 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f3910-e92c-4c67-8add-6b20bbc4678a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:09.609822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f3910-e92c-4c67-8add-6b20bbc4678a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:09.618759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c177d2d-890e-4513-b20e-1e4ad3baf690 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:09.627721 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:09.648473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-339f3910-e92c-4c67-8add-6b20bbc4678a None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:09.649703 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-339f3910-e92c-4c67-8add-6b20bbc4678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:09.666311 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53638b-5b05-47c1-ac96-d026102ddfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:09.667215 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53638b-5b05-47c1-ac96-d026102ddfc5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:09.667726 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53638b-5b05-47c1-ac96-d026102ddfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:09.668211 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53638b-5b05-47c1-ac96-d026102ddfc5 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:09.669076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53638b-5b05-47c1-ac96-d026102ddfc5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:09.669736 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53638b-5b05-47c1-ac96-d026102ddfc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:09.671634 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53638b-5b05-47c1-ac96-d026102ddfc5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:09.673825 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 144/276] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 29 20:31:09.681880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 133/277] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:31:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:09.687807 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f3910-e92c-4c67-8add-6b20bbc4678a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:09.794818 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:09.849855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53638b-5b05-47c1-ac96-d026102ddfc5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:09.865045 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53638b-5b05-47c1-ac96-d026102ddfc5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:09.871334 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f3910-e92c-4c67-8add-6b20bbc4678a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:09.881297 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8334372-3214-4aed-ade4-98a0dec9b8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:09.882249 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8334372-3214-4aed-ade4-98a0dec9b8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:09.882742 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8334372-3214-4aed-ade4-98a0dec9b8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:09.883205 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8334372-3214-4aed-ade4-98a0dec9b8c4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:09.900202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8334372-3214-4aed-ade4-98a0dec9b8c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-a8334372-3214-4aed-ade4-98a0dec9b8c4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:09.906027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:09.906884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:09.912148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:09.912148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:09.912148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:09.912148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:09.912148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:09.912148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:09.912148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:09.912148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:09.912148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:09.912148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:09.912148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:31:09.912148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:09.915520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 134/278] 10.222.0.40 () {56 vars in 1120 bytes} [Sat Oct 29 20:31:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:09.920485 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8334372-3214-4aed-ade4-98a0dec9b8c4 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:09.935248 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8334372-3214-4aed-ade4-98a0dec9b8c4 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:09.944531 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e8381-c3e1-4b3d-8fa7-7e8dea5b1ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:09.945523 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e8381-c3e1-4b3d-8fa7-7e8dea5b1ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:09.946000 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e8381-c3e1-4b3d-8fa7-7e8dea5b1ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:09.946487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e8381-c3e1-4b3d-8fa7-7e8dea5b1ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:09.947384 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e8381-c3e1-4b3d-8fa7-7e8dea5b1ba0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:09.947908 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e8381-c3e1-4b3d-8fa7-7e8dea5b1ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:09.948077 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7c404-9072-4c98-b76b-354e80691eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:09.948687 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7c404-9072-4c98-b76b-354e80691eeb None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:09.948968 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7c404-9072-4c98-b76b-354e80691eeb None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:09.949240 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7c404-9072-4c98-b76b-354e80691eeb None admin] PATH_INFO: `/v3/users/f92f12e11e534b4bb911f7a8f64e8bf1` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:09.950400 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7c404-9072-4c98-b76b-354e80691eeb None admin] RBAC: Authorizing `identity:get_user(user_id=f92f12e11e534b4bb911f7a8f64e8bf1)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:09.950748 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e8381-c3e1-4b3d-8fa7-7e8dea5b1ba0 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:09.951888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7c404-9072-4c98-b76b-354e80691eeb None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:09.958589 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 145/279] 10.222.0.40 () {56 vars in 1177 bytes} [Sat Oct 29 20:31:09 2022] GET /identity/v3/users/f92f12e11e534b4bb911f7a8f64e8bf1 => generated 293 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:09.960379 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7c404-9072-4c98-b76b-354e80691eeb None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:09.968479 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 135/280] 10.222.0.40 () {56 vars in 1122 bytes} [Sat Oct 29 20:31:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:09.974933 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e8381-c3e1-4b3d-8fa7-7e8dea5b1ba0 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:09.985423 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e8381-c3e1-4b3d-8fa7-7e8dea5b1ba0 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:09.995539 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de48156-c9c1-42af-bb28-6b7e1f750aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:09.996544 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de48156-c9c1-42af-bb28-6b7e1f750aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:09.997096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de48156-c9c1-42af-bb28-6b7e1f750aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:09.997567 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de48156-c9c1-42af-bb28-6b7e1f750aa3 admin admin] PATH_INFO: `/v3/groups/92e99d4a3298457abdce45af647781e1` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:09.998918 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de48156-c9c1-42af-bb28-6b7e1f750aa3 admin admin] RBAC: Authorizing `identity:get_group(group_id=92e99d4a3298457abdce45af647781e1)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:10.001095 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de48156-c9c1-42af-bb28-6b7e1f750aa3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:10.007676 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 136/281] 10.222.0.40 () {56 vars in 1201 bytes} [Sat Oct 29 20:31:09 2022] GET /identity/v3/groups/92e99d4a3298457abdce45af647781e1 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:10.012573 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de48156-c9c1-42af-bb28-6b7e1f750aa3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:10.022890 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de48156-c9c1-42af-bb28-6b7e1f750aa3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:10.034729 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4427819-20b0-40cb-a6db-cc3e54c191ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:10.035763 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4427819-20b0-40cb-a6db-cc3e54c191ef admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:10.036257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4427819-20b0-40cb-a6db-cc3e54c191ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:10.036722 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4427819-20b0-40cb-a6db-cc3e54c191ef admin admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:10.038075 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4427819-20b0-40cb-a6db-cc3e54c191ef admin admin] RBAC: Authorizing `identity:get_project(project_id=d2dc0b040d8141b9a5b8c2417b349712)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:10.040377 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4427819-20b0-40cb-a6db-cc3e54c191ef admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:10.047270 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 137/282] 10.222.0.40 () {56 vars in 1207 bytes} [Sat Oct 29 20:31:10 2022] GET /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:10.049355 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4427819-20b0-40cb-a6db-cc3e54c191ef admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:10.062568 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4427819-20b0-40cb-a6db-cc3e54c191ef admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:10.071399 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9792e-44d6-48ac-9d83-9a1a86333037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:10.072405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9792e-44d6-48ac-9d83-9a1a86333037 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:10.072891 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9792e-44d6-48ac-9d83-9a1a86333037 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:10.073375 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9792e-44d6-48ac-9d83-9a1a86333037 admin admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712/groups/92e99d4a3298457abdce45af647781e1/roles/b2dae64b76124d298b982ee42347b223` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:10.075549 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9792e-44d6-48ac-9d83-9a1a86333037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2dc0b040d8141b9a5b8c2417b349712, group_id=92e99d4a3298457abdce45af647781e1, role_id=b2dae64b76124d298b982ee42347b223)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:10.078525 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9792e-44d6-48ac-9d83-9a1a86333037 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:10.115500 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 138/283] 10.222.0.40 () {58 vars in 1463 bytes} [Sat Oct 29 20:31:10 2022] PUT /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712/groups/92e99d4a3298457abdce45af647781e1/roles/b2dae64b76124d298b982ee42347b223 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:31:10.117687 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0f89f-8fed-4ff7-ad54-68f26cf140f2 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:10.119768 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0f89f-8fed-4ff7-ad54-68f26cf140f2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:10.120259 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0f89f-8fed-4ff7-ad54-68f26cf140f2 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:10.123813 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 139/284] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:10.161314 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d2290-2268-40de-abe2-aa634862d957 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:10.161924 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d2290-2268-40de-abe2-aa634862d957 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:10.162468 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d2290-2268-40de-abe2-aa634862d957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:10.196439 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-309d2290-2268-40de-abe2-aa634862d957 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:10.198898 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-309d2290-2268-40de-abe2-aa634862d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:10.206320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7c404-9072-4c98-b76b-354e80691eeb None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:10.261701 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:10.297569 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f772a63-fdad-411b-80aa-357bddc533c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:10.300764 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f772a63-fdad-411b-80aa-357bddc533c8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:10.301269 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f772a63-fdad-411b-80aa-357bddc533c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:10.301742 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f772a63-fdad-411b-80aa-357bddc533c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:10.304028 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f772a63-fdad-411b-80aa-357bddc533c8 None admin] RBAC: Adding query filter params (role.id=ef7ddbd2f19b4d6295147f4a6591da72, user.id=f92f12e11e534b4bb911f7a8f64e8bf1, scope.system=all) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:10.304562 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f772a63-fdad-411b-80aa-357bddc533c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:10.307358 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f772a63-fdad-411b-80aa-357bddc533c8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:10.333474 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 146/285] 10.222.0.40 () {56 vars in 1308 bytes} [Sat Oct 29 20:31:09 2022] GET /identity/v3/role_assignments?user.id=f92f12e11e534b4bb911f7a8f64e8bf1&scope.system=all&role.id=ef7ddbd2f19b4d6295147f4a6591da72 => generated 510 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:10.334735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f772a63-fdad-411b-80aa-357bddc533c8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:10.367436 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 140/286] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 29 20:31:10.479418 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f772a63-fdad-411b-80aa-357bddc533c8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:10.493228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3f961-36c6-4071-b8a5-f0ec2180decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:10.493894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3f961-36c6-4071-b8a5-f0ec2180decb admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:10.494168 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3f961-36c6-4071-b8a5-f0ec2180decb admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:10.494432 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3f961-36c6-4071-b8a5-f0ec2180decb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:10.506600 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3f961-36c6-4071-b8a5-f0ec2180decb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-93e3f961-36c6-4071-b8a5-f0ec2180decb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:10.516450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:10.518391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:10.519428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:10.519428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:10.519428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:10.519428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:10.519428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:10.519428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:10.519428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:10.519428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:10.519428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:10.519428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:10.519428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:31:10.519428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:10.519428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 147/287] 10.222.0.40 () {56 vars in 1135 bytes} [Sat Oct 29 20:31:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:10.524458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d2290-2268-40de-abe2-aa634862d957 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:10.542515 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d2290-2268-40de-abe2-aa634862d957 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:10.551349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadcf06-4245-4432-91f3-6bb0b71f8a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:10.552377 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadcf06-4245-4432-91f3-6bb0b71f8a2c admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:10.552855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadcf06-4245-4432-91f3-6bb0b71f8a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:10.553340 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadcf06-4245-4432-91f3-6bb0b71f8a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:10.554225 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadcf06-4245-4432-91f3-6bb0b71f8a2c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:10.554732 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadcf06-4245-4432-91f3-6bb0b71f8a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:10.556768 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadcf06-4245-4432-91f3-6bb0b71f8a2c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:10.575648 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 141/288] 10.222.0.40 () {56 vars in 1132 bytes} [Sat Oct 29 20:31:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:10.582966 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3f961-36c6-4071-b8a5-f0ec2180decb admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:10.593316 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3f961-36c6-4071-b8a5-f0ec2180decb admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:10.603582 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced071b-f060-4340-b682-76b23c8cdedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:10.604228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced071b-f060-4340-b682-76b23c8cdedf admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:10.604501 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced071b-f060-4340-b682-76b23c8cdedf admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:10.604770 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced071b-f060-4340-b682-76b23c8cdedf admin admin] PATH_INFO: `/v3/groups/92e99d4a3298457abdce45af647781e1` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:10.605883 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced071b-f060-4340-b682-76b23c8cdedf admin admin] RBAC: Authorizing `identity:get_group(group_id=92e99d4a3298457abdce45af647781e1)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:10.607946 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced071b-f060-4340-b682-76b23c8cdedf admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:10.609733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 148/289] 10.222.0.40 () {56 vars in 1201 bytes} [Sat Oct 29 20:31:10 2022] GET /identity/v3/groups/92e99d4a3298457abdce45af647781e1 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:10.615590 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadcf06-4245-4432-91f3-6bb0b71f8a2c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:10.628182 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadcf06-4245-4432-91f3-6bb0b71f8a2c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:10.638069 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9037121-7552-45ca-b2dc-c9ac40f2f85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:10.638730 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9037121-7552-45ca-b2dc-c9ac40f2f85b admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:10.639002 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9037121-7552-45ca-b2dc-c9ac40f2f85b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:10.639268 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9037121-7552-45ca-b2dc-c9ac40f2f85b admin admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:10.640493 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9037121-7552-45ca-b2dc-c9ac40f2f85b admin admin] RBAC: Authorizing `identity:get_project(project_id=d2dc0b040d8141b9a5b8c2417b349712)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:10.643005 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9037121-7552-45ca-b2dc-c9ac40f2f85b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:10.644930 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 142/290] 10.222.0.40 () {56 vars in 1207 bytes} [Sat Oct 29 20:31:10 2022] GET /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:10.650511 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced071b-f060-4340-b682-76b23c8cdedf admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:10.661438 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced071b-f060-4340-b682-76b23c8cdedf admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:10.671902 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d256a-1935-4b4e-bc72-6ed58e27e93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:10.672586 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d256a-1935-4b4e-bc72-6ed58e27e93a admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:10.672862 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d256a-1935-4b4e-bc72-6ed58e27e93a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:10.673234 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d256a-1935-4b4e-bc72-6ed58e27e93a admin admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712/groups/92e99d4a3298457abdce45af647781e1/roles/d6c014b407594f248f451d331253c8a6` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:10.675720 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d256a-1935-4b4e-bc72-6ed58e27e93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2dc0b040d8141b9a5b8c2417b349712, group_id=92e99d4a3298457abdce45af647781e1, role_id=d6c014b407594f248f451d331253c8a6)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:10.678412 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d256a-1935-4b4e-bc72-6ed58e27e93a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:10.704185 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 149/291] 10.222.0.40 () {58 vars in 1463 bytes} [Sat Oct 29 20:31:10 2022] PUT /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712/groups/92e99d4a3298457abdce45af647781e1/roles/d6c014b407594f248f451d331253c8a6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:31:10.922260 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9037121-7552-45ca-b2dc-c9ac40f2f85b admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:10.936622 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9037121-7552-45ca-b2dc-c9ac40f2f85b admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:11.014585 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc6198-990d-4f43-80ac-49ba28a0d2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:11.015225 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc6198-990d-4f43-80ac-49ba28a0d2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:11.015525 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc6198-990d-4f43-80ac-49ba28a0d2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:11.015793 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc6198-990d-4f43-80ac-49ba28a0d2f4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:11.024966 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:11.029405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc6198-990d-4f43-80ac-49ba28a0d2f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-7dcc6198-990d-4f43-80ac-49ba28a0d2f4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:11.035198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:11.036085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:11.036859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:11.036859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:11.036859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:11.036859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:11.036859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:11.036859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:11.036859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:11.036859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:11.036859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:11.036859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:11.036859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:31:11.036859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:11.038462 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 143/292] 10.222.0.40 () {56 vars in 1117 bytes} [Sat Oct 29 20:31:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:11.044669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d256a-1935-4b4e-bc72-6ed58e27e93a admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:11.059913 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d256a-1935-4b4e-bc72-6ed58e27e93a admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:11.065249 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12babbb4-ae59-4bec-a8e5-ea7339d31127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:11.066020 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12babbb4-ae59-4bec-a8e5-ea7339d31127 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:11.066474 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12babbb4-ae59-4bec-a8e5-ea7339d31127 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:11.066928 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12babbb4-ae59-4bec-a8e5-ea7339d31127 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:11.067793 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12babbb4-ae59-4bec-a8e5-ea7339d31127 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:11.068280 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12babbb4-ae59-4bec-a8e5-ea7339d31127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:11.070029 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12babbb4-ae59-4bec-a8e5-ea7339d31127 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:11.083602 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 150/293] 10.222.0.40 () {56 vars in 1120 bytes} [Sat Oct 29 20:31:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:11.089693 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc6198-990d-4f43-80ac-49ba28a0d2f4 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:11.100886 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc6198-990d-4f43-80ac-49ba28a0d2f4 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:11.105769 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7ac58-7452-4cbc-a262-fa48ba168e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:11.106614 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7ac58-7452-4cbc-a262-fa48ba168e1c admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:11.107047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7ac58-7452-4cbc-a262-fa48ba168e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:11.107516 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7ac58-7452-4cbc-a262-fa48ba168e1c admin admin] PATH_INFO: `/v3/groups/19897a2c034444109d87562a854cf943` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:11.114236 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7ac58-7452-4cbc-a262-fa48ba168e1c admin admin] RBAC: Authorizing `identity:get_group(group_id=19897a2c034444109d87562a854cf943)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:11.116499 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7ac58-7452-4cbc-a262-fa48ba168e1c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:11.119619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 144/294] 10.222.0.40 () {56 vars in 1201 bytes} [Sat Oct 29 20:31:11 2022] GET /identity/v3/groups/19897a2c034444109d87562a854cf943 => generated 229 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:11.124450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12babbb4-ae59-4bec-a8e5-ea7339d31127 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:11.136588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12babbb4-ae59-4bec-a8e5-ea7339d31127 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:11.145560 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76af5c-58c0-4d9c-8f53-fbac67c7ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:11.146437 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76af5c-58c0-4d9c-8f53-fbac67c7ad9e admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:11.146863 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76af5c-58c0-4d9c-8f53-fbac67c7ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:11.147273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76af5c-58c0-4d9c-8f53-fbac67c7ad9e admin admin] PATH_INFO: `/v3/projects/5ed5676f4e9241dc85909bd15e1b9406` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:11.149490 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76af5c-58c0-4d9c-8f53-fbac67c7ad9e admin admin] RBAC: Authorizing `identity:get_project(project_id=5ed5676f4e9241dc85909bd15e1b9406)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:11.151606 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76af5c-58c0-4d9c-8f53-fbac67c7ad9e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:11.153874 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 151/295] 10.222.0.40 () {56 vars in 1207 bytes} [Sat Oct 29 20:31:11 2022] GET /identity/v3/projects/5ed5676f4e9241dc85909bd15e1b9406 => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:11.159235 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7ac58-7452-4cbc-a262-fa48ba168e1c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:11.170157 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7ac58-7452-4cbc-a262-fa48ba168e1c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:11.175842 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d90e4-3574-48dc-83f2-8aaa457d0e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:11.176701 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d90e4-3574-48dc-83f2-8aaa457d0e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:11.177179 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d90e4-3574-48dc-83f2-8aaa457d0e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:11.177593 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d90e4-3574-48dc-83f2-8aaa457d0e93 admin admin] PATH_INFO: `/v3/projects/5ed5676f4e9241dc85909bd15e1b9406/groups/19897a2c034444109d87562a854cf943/roles/9b15e747c88749bfb25139f3bd80b395` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:11.179862 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d90e4-3574-48dc-83f2-8aaa457d0e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed5676f4e9241dc85909bd15e1b9406, group_id=19897a2c034444109d87562a854cf943, role_id=9b15e747c88749bfb25139f3bd80b395)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:11.182901 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d90e4-3574-48dc-83f2-8aaa457d0e93 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:11.201281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 145/296] 10.222.0.40 () {58 vars in 1463 bytes} [Sat Oct 29 20:31:11 2022] PUT /identity/v3/projects/5ed5676f4e9241dc85909bd15e1b9406/groups/19897a2c034444109d87562a854cf943/roles/9b15e747c88749bfb25139f3bd80b395 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 20:31:11.786281 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd449894-17c0-4d39-b5d9-7de287841600 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:11.787386 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd449894-17c0-4d39-b5d9-7de287841600 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:11.788075 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd449894-17c0-4d39-b5d9-7de287841600 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:11.790065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 152/297] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:11.795359 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e17b9-de95-414f-b908-d225d2038ba7 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:11.796204 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e17b9-de95-414f-b908-d225d2038ba7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:11.796952 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e17b9-de95-414f-b908-d225d2038ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:11.821281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-d25e17b9-de95-414f-b908-d225d2038ba7 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:11.823010 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d25e17b9-de95-414f-b908-d225d2038ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:11.904542 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 146/298] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:12.313360 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd449894-17c0-4d39-b5d9-7de287841600 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:12.427808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:12.445170 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd449894-17c0-4d39-b5d9-7de287841600 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:12.493814 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f60dd-0c9c-4ad9-830a-37e52e044049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:12.494808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f60dd-0c9c-4ad9-830a-37e52e044049 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:12.495283 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f60dd-0c9c-4ad9-830a-37e52e044049 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:12.495871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f60dd-0c9c-4ad9-830a-37e52e044049 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:12.510989 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f60dd-0c9c-4ad9-830a-37e52e044049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-852f60dd-0c9c-4ad9-830a-37e52e044049 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:12.516422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:12.517343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:12.518337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:12.518337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:12.518337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:12.518337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:12.518337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:12.518337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:12.518337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:12.518337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:12.518337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:12.518337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:12.518337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:31:12.518337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:12.521505 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639f3d-8b6a-4575-b2a2-f8bb27a3560c None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:12.521759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639f3d-8b6a-4575-b2a2-f8bb27a3560c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:12.522034 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639f3d-8b6a-4575-b2a2-f8bb27a3560c None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:12.523652 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 153/299] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:31:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:12.527616 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 147/300] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:12.529113 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f60dd-0c9c-4ad9-830a-37e52e044049 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:12.537862 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fd928-c24a-4bdf-9945-f40257cd0c56 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:12.538136 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fd928-c24a-4bdf-9945-f40257cd0c56 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:12.538409 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fd928-c24a-4bdf-9945-f40257cd0c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:12.580479 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-320fd928-c24a-4bdf-9945-f40257cd0c56 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:12.582979 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-320fd928-c24a-4bdf-9945-f40257cd0c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:12.716708 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f60dd-0c9c-4ad9-830a-37e52e044049 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:12.729987 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 148/301] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 29 20:31:12.768961 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14eb91-439f-4a13-8462-ce39328eaac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:12.769491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14eb91-439f-4a13-8462-ce39328eaac1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:12.769763 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14eb91-439f-4a13-8462-ce39328eaac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:12.770031 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14eb91-439f-4a13-8462-ce39328eaac1 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:12.770682 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14eb91-439f-4a13-8462-ce39328eaac1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:12.770977 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14eb91-439f-4a13-8462-ce39328eaac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:12.772402 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14eb91-439f-4a13-8462-ce39328eaac1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:12.787702 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 154/302] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:31:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:12.793588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fd928-c24a-4bdf-9945-f40257cd0c56 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:12.843234 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:12.914559 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fd928-c24a-4bdf-9945-f40257cd0c56 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:12.956321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dcfda-580a-4206-a120-f080c2107996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:12.956925 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dcfda-580a-4206-a120-f080c2107996 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:12.957199 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dcfda-580a-4206-a120-f080c2107996 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:12.957466 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dcfda-580a-4206-a120-f080c2107996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:13.050241 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dcfda-580a-4206-a120-f080c2107996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:13.051680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dcfda-580a-4206-a120-f080c2107996 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:13.091918 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:13.170641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 149/303] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:31:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:31:13.177118 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14eb91-439f-4a13-8462-ce39328eaac1 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:13.191177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:13.328798 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14eb91-439f-4a13-8462-ce39328eaac1 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:13.370533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dcfda-580a-4206-a120-f080c2107996 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:13.373830 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7271f-0780-448e-8a4a-725fc3f434bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:13.374578 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7271f-0780-448e-8a4a-725fc3f434bb None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:13.374857 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7271f-0780-448e-8a4a-725fc3f434bb None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:13.375124 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7271f-0780-448e-8a4a-725fc3f434bb None admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:13.379685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7271f-0780-448e-8a4a-725fc3f434bb None admin] RBAC: Authorizing `identity:get_project(project_id=6c41b3079f3f49db85d760bd5ef1f568)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:13.381172 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7271f-0780-448e-8a4a-725fc3f434bb None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:13.383267 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 155/304] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:31:13 2022] GET /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:13.398830 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7271f-0780-448e-8a4a-725fc3f434bb None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:13.494427 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dcfda-580a-4206-a120-f080c2107996 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:13.528195 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:13.535628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51892c1e-b735-49d0-a845-685c8b949f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:13.536253 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51892c1e-b735-49d0-a845-685c8b949f09 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:13.536521 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51892c1e-b735-49d0-a845-685c8b949f09 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:13.536788 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51892c1e-b735-49d0-a845-685c8b949f09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:13.553353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:13.564186 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7271f-0780-448e-8a4a-725fc3f434bb None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:13.567291 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51892c1e-b735-49d0-a845-685c8b949f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-51892c1e-b735-49d0-a845-685c8b949f09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:13.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:13.577006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:13.577819 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:13.577819 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:13.577819 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:13.577819 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:13.577819 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:13.577819 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:13.577819 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:13.577819 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:13.577819 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:13.577819 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:13.577819 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:31:13.577819 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:13.582812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 150/305] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:31:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:13.589246 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51892c1e-b735-49d0-a845-685c8b949f09 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:13.638713 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c073e-07a3-46e9-8dda-60eba708fa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:13.639779 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c073e-07a3-46e9-8dda-60eba708fa2c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:13.640057 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c073e-07a3-46e9-8dda-60eba708fa2c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:13.640331 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c073e-07a3-46e9-8dda-60eba708fa2c None admin] PATH_INFO: `/v3/groups/92e99d4a3298457abdce45af647781e1` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:13.641998 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c073e-07a3-46e9-8dda-60eba708fa2c None admin] RBAC: Authorizing `identity:get_group(group_id=92e99d4a3298457abdce45af647781e1)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:13.644711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c073e-07a3-46e9-8dda-60eba708fa2c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:13.646966 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 156/306] 10.222.0.40 () {56 vars in 1180 bytes} [Sat Oct 29 20:31:13 2022] GET /identity/v3/groups/92e99d4a3298457abdce45af647781e1 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:13.652140 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e35b1-2ec3-4a37-8a8b-9aab573cb5fa None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:13.652591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e35b1-2ec3-4a37-8a8b-9aab573cb5fa None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:13.653169 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e35b1-2ec3-4a37-8a8b-9aab573cb5fa None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:13.656935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 157/307] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:13.658231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e35b1-2ec3-4a37-8a8b-9aab573cb5fa None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:13.740614 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51892c1e-b735-49d0-a845-685c8b949f09 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:13.782003 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e35b1-2ec3-4a37-8a8b-9aab573cb5fa None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:13.793534 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c1ea4-5f7c-460c-859d-7c4072e8d857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:13.794127 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c1ea4-5f7c-460c-859d-7c4072e8d857 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:13.794402 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c1ea4-5f7c-460c-859d-7c4072e8d857 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:13.794670 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c1ea4-5f7c-460c-859d-7c4072e8d857 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:13.795354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c1ea4-5f7c-460c-859d-7c4072e8d857 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:13.795655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c1ea4-5f7c-460c-859d-7c4072e8d857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:13.797362 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c1ea4-5f7c-460c-859d-7c4072e8d857 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:13.808394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 151/308] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:13.809626 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23007f7-6eb6-4fdc-a64c-8b8c9dd7b84c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:13.809984 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23007f7-6eb6-4fdc-a64c-8b8c9dd7b84c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:13.810171 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23007f7-6eb6-4fdc-a64c-8b8c9dd7b84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:13.834748 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9a881-1f60-46bd-abc9-4cc43d5e003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:13.836044 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9a881-1f60-46bd-abc9-4cc43d5e003c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:13.836642 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9a881-1f60-46bd-abc9-4cc43d5e003c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:13.837127 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9a881-1f60-46bd-abc9-4cc43d5e003c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:13.837230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-a23007f7-6eb6-4fdc-a64c-8b8c9dd7b84c None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:13.838174 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9a881-1f60-46bd-abc9-4cc43d5e003c None admin] RBAC: Adding query filter params (group.id=92e99d4a3298457abdce45af647781e1, role.id=b2dae64b76124d298b982ee42347b223, scope.project.id=6c41b3079f3f49db85d760bd5ef1f568) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:13.838477 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a23007f7-6eb6-4fdc-a64c-8b8c9dd7b84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:13.838916 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9a881-1f60-46bd-abc9-4cc43d5e003c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:13.840929 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9a881-1f60-46bd-abc9-4cc43d5e003c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:13.849101 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 158/309] 10.222.0.40 () {56 vars in 1376 bytes} [Sat Oct 29 20:31:13 2022] GET /identity/v3/role_assignments?group.id=92e99d4a3298457abdce45af647781e1&scope.project.id=6c41b3079f3f49db85d760bd5ef1f568&role.id=b2dae64b76124d298b982ee42347b223 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:13.850995 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9a881-1f60-46bd-abc9-4cc43d5e003c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:13.868897 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:13.920815 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:13.935271 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 152/310] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:13.936624 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b2726-f40c-49f0-b939-9c4c748f90b4 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:13.936908 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b2726-f40c-49f0-b939-9c4c748f90b4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:13.937180 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b2726-f40c-49f0-b939-9c4c748f90b4 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:13.938850 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 153/311] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:13.944150 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2b37c-9418-40b7-952b-de1b66a33926 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:13.944428 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2b37c-9418-40b7-952b-de1b66a33926 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:13.944700 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2b37c-9418-40b7-952b-de1b66a33926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:13.964842 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-65d2b37c-9418-40b7-952b-de1b66a33926 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:13.966053 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-65d2b37c-9418-40b7-952b-de1b66a33926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:14.016249 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9a881-1f60-46bd-abc9-4cc43d5e003c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:14.087453 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34aaee-e00b-4a4c-99ca-f077389034fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:14.088489 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34aaee-e00b-4a4c-99ca-f077389034fd None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:14.088765 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34aaee-e00b-4a4c-99ca-f077389034fd None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:14.089035 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34aaee-e00b-4a4c-99ca-f077389034fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:14.097001 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 154/312] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:31:14.193142 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34aaee-e00b-4a4c-99ca-f077389034fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:14.194646 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34aaee-e00b-4a4c-99ca-f077389034fd None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:14.209770 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:14.313291 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 159/313] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:31:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:31:14.319526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2b37c-9418-40b7-952b-de1b66a33926 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:14.375357 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34aaee-e00b-4a4c-99ca-f077389034fd None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:14.440636 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2b37c-9418-40b7-952b-de1b66a33926 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:14.463626 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:14.484355 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d2db7-230c-4b27-9a01-36184f5746f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:14.485352 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d2db7-230c-4b27-9a01-36184f5746f8 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:14.485902 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d2db7-230c-4b27-9a01-36184f5746f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:14.486379 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d2db7-230c-4b27-9a01-36184f5746f8 None admin] PATH_INFO: `/v3/projects/6c41b3079f3f49db85d760bd5ef1f568` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:14.487760 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d2db7-230c-4b27-9a01-36184f5746f8 None admin] RBAC: Authorizing `identity:get_project(project_id=6c41b3079f3f49db85d760bd5ef1f568)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:14.489404 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d2db7-230c-4b27-9a01-36184f5746f8 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:14.491592 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 155/314] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:31:14 2022] GET /identity/v3/projects/6c41b3079f3f49db85d760bd5ef1f568 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:14.500538 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d2db7-230c-4b27-9a01-36184f5746f8 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:14.530633 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34aaee-e00b-4a4c-99ca-f077389034fd None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:14.543004 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:14.571255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c96687-9382-40bc-aad6-19ccf42f53fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:14.571957 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c96687-9382-40bc-aad6-19ccf42f53fa None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:14.572237 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c96687-9382-40bc-aad6-19ccf42f53fa None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:14.572511 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c96687-9382-40bc-aad6-19ccf42f53fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:14.586252 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c96687-9382-40bc-aad6-19ccf42f53fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-92c96687-9382-40bc-aad6-19ccf42f53fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:14.591996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:14.592908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:14.594082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:14.594082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:14.594082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:14.594082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:14.594082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:14.594082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:14.594082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:14.594082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:14.594082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:14.594082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:14.594082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 20:31:14.594082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:14.594082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 160/315] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:31:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:31:14.594715 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5c97c-d74e-4cb0-8100-c2983075abac None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:14.595931 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5c97c-d74e-4cb0-8100-c2983075abac None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:14.595931 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5c97c-d74e-4cb0-8100-c2983075abac None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:14.598277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 161/316] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:14.598277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5c97c-d74e-4cb0-8100-c2983075abac None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:14.629866 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d2db7-230c-4b27-9a01-36184f5746f8 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:14.674697 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ba9b0-a007-4a54-bcc7-fe1b908e6978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:14.675423 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ba9b0-a007-4a54-bcc7-fe1b908e6978 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:14.675658 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ba9b0-a007-4a54-bcc7-fe1b908e6978 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:14.675914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ba9b0-a007-4a54-bcc7-fe1b908e6978 None admin] PATH_INFO: `/v3/groups/92e99d4a3298457abdce45af647781e1` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:14.677199 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ba9b0-a007-4a54-bcc7-fe1b908e6978 None admin] RBAC: Authorizing `identity:get_group(group_id=92e99d4a3298457abdce45af647781e1)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:14.678979 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ba9b0-a007-4a54-bcc7-fe1b908e6978 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:14.680782 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 156/317] 10.222.0.40 () {56 vars in 1180 bytes} [Sat Oct 29 20:31:14 2022] GET /identity/v3/groups/92e99d4a3298457abdce45af647781e1 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:14.681689 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d78f7f-3796-43f5-be27-3328ef76580b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:14.682459 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d78f7f-3796-43f5-be27-3328ef76580b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:14.682459 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d78f7f-3796-43f5-be27-3328ef76580b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:14.701688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-61d78f7f-3796-43f5-be27-3328ef76580b None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:14.702870 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-61d78f7f-3796-43f5-be27-3328ef76580b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:14.721525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5c97c-d74e-4cb0-8100-c2983075abac None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:14.761472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d028b08-d412-4d05-ae7e-1dacf96bad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:14.762112 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d028b08-d412-4d05-ae7e-1dacf96bad59 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:14.762754 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d028b08-d412-4d05-ae7e-1dacf96bad59 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:14.762754 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d028b08-d412-4d05-ae7e-1dacf96bad59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:14.765934 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:14.778310 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d028b08-d412-4d05-ae7e-1dacf96bad59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-6d028b08-d412-4d05-ae7e-1dacf96bad59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:14.784472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:14.785525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:14.786451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:14.786451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:14.786451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:14.786451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:14.786451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:14.786451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:14.786451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:14.786451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:14.786451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:14.786451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:14.786451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 20:31:14.786451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:14.786451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 162/318] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:31:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:14.786451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d028b08-d412-4d05-ae7e-1dacf96bad59 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:14.794509 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 157/319] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:14.794509 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d78f7f-3796-43f5-be27-3328ef76580b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:14.821664 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:14.913831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d028b08-d412-4d05-ae7e-1dacf96bad59 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:14.933134 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d78f7f-3796-43f5-be27-3328ef76580b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:14.961791 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d36eb-f075-4418-9171-b1e65fe894b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:14.962399 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d36eb-f075-4418-9171-b1e65fe894b3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:14.963232 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d36eb-f075-4418-9171-b1e65fe894b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:14.963443 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d36eb-f075-4418-9171-b1e65fe894b3 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:14.964304 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d36eb-f075-4418-9171-b1e65fe894b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:14.964605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d36eb-f075-4418-9171-b1e65fe894b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:14.966560 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d36eb-f075-4418-9171-b1e65fe894b3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:14.976876 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 163/320] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:31:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:14.976876 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d36eb-f075-4418-9171-b1e65fe894b3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:14.977887 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffda947-b5ad-4c18-a214-127b1ba8d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:14.978731 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffda947-b5ad-4c18-a214-127b1ba8d784 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:14.979211 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffda947-b5ad-4c18-a214-127b1ba8d784 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:14.979683 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffda947-b5ad-4c18-a214-127b1ba8d784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:14.980593 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffda947-b5ad-4c18-a214-127b1ba8d784 None admin] RBAC: Adding query filter params (group.id=92e99d4a3298457abdce45af647781e1, role.id=d6c014b407594f248f451d331253c8a6, scope.project.id=6c41b3079f3f49db85d760bd5ef1f568) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:14.980902 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffda947-b5ad-4c18-a214-127b1ba8d784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:14.982423 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffda947-b5ad-4c18-a214-127b1ba8d784 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:14.995349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 158/321] 10.222.0.40 () {56 vars in 1376 bytes} [Sat Oct 29 20:31:14 2022] GET /identity/v3/role_assignments?group.id=92e99d4a3298457abdce45af647781e1&scope.project.id=6c41b3079f3f49db85d760bd5ef1f568&role.id=d6c014b407594f248f451d331253c8a6 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:14.995349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffda947-b5ad-4c18-a214-127b1ba8d784 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:15.051538 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:15.102732 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:15.114076 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d36eb-f075-4418-9171-b1e65fe894b3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:15.114420 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffda947-b5ad-4c18-a214-127b1ba8d784 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:15.157092 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bf6b0-3003-4e8a-9dab-8cf1c98a8399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:15.158701 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bf6b0-3003-4e8a-9dab-8cf1c98a8399 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:15.158810 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96a520-2f93-4a26-b7f0-051ef6c79481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:15.159368 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bf6b0-3003-4e8a-9dab-8cf1c98a8399 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:15.159487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96a520-2f93-4a26-b7f0-051ef6c79481 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:15.159826 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96a520-2f93-4a26-b7f0-051ef6c79481 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:15.160103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96a520-2f93-4a26-b7f0-051ef6c79481 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:15.160346 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bf6b0-3003-4e8a-9dab-8cf1c98a8399 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:15.161424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bf6b0-3003-4e8a-9dab-8cf1c98a8399 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:15.161933 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bf6b0-3003-4e8a-9dab-8cf1c98a8399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:15.163613 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bf6b0-3003-4e8a-9dab-8cf1c98a8399 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:15.174393 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 164/322] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:15.175674 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bf6b0-3003-4e8a-9dab-8cf1c98a8399 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:15.253473 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96a520-2f93-4a26-b7f0-051ef6c79481 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:15.254948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96a520-2f93-4a26-b7f0-051ef6c79481 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:15.319041 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:15.322520 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bf6b0-3003-4e8a-9dab-8cf1c98a8399 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:15.365933 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b95e89-ecf1-436e-9924-d4eec70b3349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:15.366580 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b95e89-ecf1-436e-9924-d4eec70b3349 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:15.366860 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b95e89-ecf1-436e-9924-d4eec70b3349 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:15.367131 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b95e89-ecf1-436e-9924-d4eec70b3349 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:15.379506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b95e89-ecf1-436e-9924-d4eec70b3349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-a4b95e89-ecf1-436e-9924-d4eec70b3349 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:15.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:15.385854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:15.386653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:15.386653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:15.386653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:15.386653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:15.386653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:15.386653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:15.386653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:15.386653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:15.386653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:15.386653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:15.386653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:31:15.386653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:15.387252 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 159/323] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:31:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:31:15.387373 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 165/324] 10.222.0.40 () {56 vars in 1096 bytes} [Sat Oct 29 20:31:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:15.387961 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96a520-2f93-4a26-b7f0-051ef6c79481 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:15.392253 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b95e89-ecf1-436e-9924-d4eec70b3349 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:15.408563 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:15.504439 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96a520-2f93-4a26-b7f0-051ef6c79481 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:15.518024 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b95e89-ecf1-436e-9924-d4eec70b3349 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:15.545331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863afcd-4a28-4af7-ab37-dc32993cb8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:15.545939 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863afcd-4a28-4af7-ab37-dc32993cb8a6 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:15.546216 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863afcd-4a28-4af7-ab37-dc32993cb8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:15.546739 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863afcd-4a28-4af7-ab37-dc32993cb8a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:15.565291 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df1f68-e155-4f57-95e1-dd929faa29ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:15.565909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df1f68-e155-4f57-95e1-dd929faa29ff None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:15.566186 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df1f68-e155-4f57-95e1-dd929faa29ff None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:15.566457 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df1f68-e155-4f57-95e1-dd929faa29ff None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:15.567241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df1f68-e155-4f57-95e1-dd929faa29ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:15.567578 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df1f68-e155-4f57-95e1-dd929faa29ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:15.568857 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df1f68-e155-4f57-95e1-dd929faa29ff None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:15.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:15.579648 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 166/325] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:31:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:15.580481 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df1f68-e155-4f57-95e1-dd929faa29ff None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:15.629593 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863afcd-4a28-4af7-ab37-dc32993cb8a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:15.630987 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863afcd-4a28-4af7-ab37-dc32993cb8a6 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:15.670911 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:15.694405 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df1f68-e155-4f57-95e1-dd929faa29ff None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:15.728113 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dead7c2-c0ad-4938-93fa-1b4518e52c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:15.728933 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dead7c2-c0ad-4938-93fa-1b4518e52c06 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:15.729370 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dead7c2-c0ad-4938-93fa-1b4518e52c06 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:15.729636 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dead7c2-c0ad-4938-93fa-1b4518e52c06 None admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:15.730739 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dead7c2-c0ad-4938-93fa-1b4518e52c06 None admin] RBAC: Authorizing `identity:get_project(project_id=d2dc0b040d8141b9a5b8c2417b349712)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:15.732200 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dead7c2-c0ad-4938-93fa-1b4518e52c06 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:15.733796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 167/326] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:31:15 2022] GET /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:15.739088 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dead7c2-c0ad-4938-93fa-1b4518e52c06 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:15.739202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 160/327] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:31:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:31:15.740043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863afcd-4a28-4af7-ab37-dc32993cb8a6 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:15.790977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:15.836751 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dead7c2-c0ad-4938-93fa-1b4518e52c06 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:15.841364 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863afcd-4a28-4af7-ab37-dc32993cb8a6 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:15.871229 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96747a95-bafa-4bf0-95fc-f4821f41fe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:15.871859 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96747a95-bafa-4bf0-95fc-f4821f41fe87 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:15.872131 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96747a95-bafa-4bf0-95fc-f4821f41fe87 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:15.872402 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96747a95-bafa-4bf0-95fc-f4821f41fe87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:15.878943 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e22393-76ab-4abd-a227-a51d43f909f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:15.879592 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e22393-76ab-4abd-a227-a51d43f909f2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:15.879867 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e22393-76ab-4abd-a227-a51d43f909f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:15.880134 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e22393-76ab-4abd-a227-a51d43f909f2 None admin] PATH_INFO: `/v3/groups/92e99d4a3298457abdce45af647781e1` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:15.881225 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e22393-76ab-4abd-a227-a51d43f909f2 None admin] RBAC: Authorizing `identity:get_group(group_id=92e99d4a3298457abdce45af647781e1)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:15.882652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e22393-76ab-4abd-a227-a51d43f909f2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:15.884632 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 161/328] 10.222.0.40 () {56 vars in 1180 bytes} [Sat Oct 29 20:31:15 2022] GET /identity/v3/groups/92e99d4a3298457abdce45af647781e1 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:15.884956 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e22393-76ab-4abd-a227-a51d43f909f2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:15.889684 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:15.944725 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96747a95-bafa-4bf0-95fc-f4821f41fe87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:15.946199 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96747a95-bafa-4bf0-95fc-f4821f41fe87 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:15.987536 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e22393-76ab-4abd-a227-a51d43f909f2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:16.005184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:16.023087 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eee26-1bd0-4b1e-94f0-3624785ee881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:16.023755 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eee26-1bd0-4b1e-94f0-3624785ee881 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:16.024029 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eee26-1bd0-4b1e-94f0-3624785ee881 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:16.024301 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eee26-1bd0-4b1e-94f0-3624785ee881 None admin] PATH_INFO: `/v3/projects/d2dc0b040d8141b9a5b8c2417b349712` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:16.025419 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eee26-1bd0-4b1e-94f0-3624785ee881 None admin] RBAC: Authorizing `identity:get_project(project_id=d2dc0b040d8141b9a5b8c2417b349712)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:16.026840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eee26-1bd0-4b1e-94f0-3624785ee881 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:16.028469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 162/329] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:31:15 2022] GET /identity/v3/projects/d2dc0b040d8141b9a5b8c2417b349712 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:16.033153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eee26-1bd0-4b1e-94f0-3624785ee881 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:16.045111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 168/330] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:31:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:31:16.048537 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96747a95-bafa-4bf0-95fc-f4821f41fe87 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:16.092827 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:16.130331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eee26-1bd0-4b1e-94f0-3624785ee881 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:16.145377 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96747a95-bafa-4bf0-95fc-f4821f41fe87 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:16.164747 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7b7e0-ffa7-45f8-8b12-fbbd697cd9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:16.165345 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7b7e0-ffa7-45f8-8b12-fbbd697cd9c0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:16.165614 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7b7e0-ffa7-45f8-8b12-fbbd697cd9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:16.165877 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7b7e0-ffa7-45f8-8b12-fbbd697cd9c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:16.166576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7b7e0-ffa7-45f8-8b12-fbbd697cd9c0 None admin] RBAC: Adding query filter params (group.id=92e99d4a3298457abdce45af647781e1, role.id=b2dae64b76124d298b982ee42347b223, scope.project.id=d2dc0b040d8141b9a5b8c2417b349712) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:16.166874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7b7e0-ffa7-45f8-8b12-fbbd697cd9c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:16.168312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7b7e0-ffa7-45f8-8b12-fbbd697cd9c0 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:16.175069 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 163/331] 10.222.0.40 () {56 vars in 1376 bytes} [Sat Oct 29 20:31:16 2022] GET /identity/v3/role_assignments?group.id=92e99d4a3298457abdce45af647781e1&scope.project.id=d2dc0b040d8141b9a5b8c2417b349712&role.id=b2dae64b76124d298b982ee42347b223 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:16.175648 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7b7e0-ffa7-45f8-8b12-fbbd697cd9c0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:16.182525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abec3ab-4be6-49db-80c2-df01f4429a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:16.186076 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abec3ab-4be6-49db-80c2-df01f4429a06 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:16.186454 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abec3ab-4be6-49db-80c2-df01f4429a06 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:16.186928 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abec3ab-4be6-49db-80c2-df01f4429a06 None admin] PATH_INFO: `/v3/groups/92e99d4a3298457abdce45af647781e1` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:16.189529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abec3ab-4be6-49db-80c2-df01f4429a06 None admin] RBAC: Authorizing `identity:get_group(group_id=92e99d4a3298457abdce45af647781e1)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:16.191498 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abec3ab-4be6-49db-80c2-df01f4429a06 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:16.193468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 169/332] 10.222.0.40 () {56 vars in 1180 bytes} [Sat Oct 29 20:31:16 2022] GET /identity/v3/groups/92e99d4a3298457abdce45af647781e1 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:16.199687 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abec3ab-4be6-49db-80c2-df01f4429a06 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:16.234266 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:16.302812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7b7e0-ffa7-45f8-8b12-fbbd697cd9c0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:16.320279 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abec3ab-4be6-49db-80c2-df01f4429a06 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:16.335952 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:16.342093 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e751bb-cd16-4953-bd66-8f38d1da5aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:16.342745 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e751bb-cd16-4953-bd66-8f38d1da5aaf None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:16.343020 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e751bb-cd16-4953-bd66-8f38d1da5aaf None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:16.343290 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e751bb-cd16-4953-bd66-8f38d1da5aaf None admin] PATH_INFO: `/v3/projects/5ed5676f4e9241dc85909bd15e1b9406` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:16.344533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e751bb-cd16-4953-bd66-8f38d1da5aaf None admin] RBAC: Authorizing `identity:get_project(project_id=5ed5676f4e9241dc85909bd15e1b9406)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:16.346625 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e751bb-cd16-4953-bd66-8f38d1da5aaf None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:16.348735 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 164/333] 10.222.0.40 () {56 vars in 1186 bytes} [Sat Oct 29 20:31:16 2022] GET /identity/v3/projects/5ed5676f4e9241dc85909bd15e1b9406 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:16.354198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e751bb-cd16-4953-bd66-8f38d1da5aaf None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:16.364274 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db743af6-9cfa-48f9-8403-12c4486863cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:16.365477 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db743af6-9cfa-48f9-8403-12c4486863cc None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:16.365756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db743af6-9cfa-48f9-8403-12c4486863cc None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:16.366023 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db743af6-9cfa-48f9-8403-12c4486863cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:16.366763 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db743af6-9cfa-48f9-8403-12c4486863cc None admin] RBAC: Adding query filter params (group.id=92e99d4a3298457abdce45af647781e1, role.id=d6c014b407594f248f451d331253c8a6, scope.project.id=d2dc0b040d8141b9a5b8c2417b349712) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:16.367074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db743af6-9cfa-48f9-8403-12c4486863cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:16.368586 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db743af6-9cfa-48f9-8403-12c4486863cc None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:16.375387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 170/334] 10.222.0.40 () {56 vars in 1376 bytes} [Sat Oct 29 20:31:16 2022] GET /identity/v3/role_assignments?group.id=92e99d4a3298457abdce45af647781e1&scope.project.id=d2dc0b040d8141b9a5b8c2417b349712&role.id=d6c014b407594f248f451d331253c8a6 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:16.484734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e751bb-cd16-4953-bd66-8f38d1da5aaf None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:16.505265 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:16.523568 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e63169-dc98-4970-97d9-c6d2dd705cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:16.524214 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63169-dc98-4970-97d9-c6d2dd705cd3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:16.524489 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63169-dc98-4970-97d9-c6d2dd705cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:16.524760 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63169-dc98-4970-97d9-c6d2dd705cd3 None admin] PATH_INFO: `/v3/groups/19897a2c034444109d87562a854cf943` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:16.525924 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e63169-dc98-4970-97d9-c6d2dd705cd3 None admin] RBAC: Authorizing `identity:get_group(group_id=19897a2c034444109d87562a854cf943)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:16.527440 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e63169-dc98-4970-97d9-c6d2dd705cd3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:16.529532 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 165/335] 10.222.0.40 () {56 vars in 1180 bytes} [Sat Oct 29 20:31:16 2022] GET /identity/v3/groups/19897a2c034444109d87562a854cf943 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:16.536890 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db743af6-9cfa-48f9-8403-12c4486863cc None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:16.660737 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db743af6-9cfa-48f9-8403-12c4486863cc None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:16.695391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0133b2d-0a03-4e06-b084-589f32588859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:16.695998 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0133b2d-0a03-4e06-b084-589f32588859 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:16.696276 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0133b2d-0a03-4e06-b084-589f32588859 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:16.696546 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0133b2d-0a03-4e06-b084-589f32588859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:16.697262 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0133b2d-0a03-4e06-b084-589f32588859 None admin] RBAC: Adding query filter params (group.id=19897a2c034444109d87562a854cf943, role.id=9b15e747c88749bfb25139f3bd80b395, scope.project.id=5ed5676f4e9241dc85909bd15e1b9406) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:16.697568 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0133b2d-0a03-4e06-b084-589f32588859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:16.699003 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0133b2d-0a03-4e06-b084-589f32588859 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:16.705727 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 171/336] 10.222.0.40 () {56 vars in 1376 bytes} [Sat Oct 29 20:31:16 2022] GET /identity/v3/role_assignments?group.id=19897a2c034444109d87562a854cf943&scope.project.id=5ed5676f4e9241dc85909bd15e1b9406&role.id=9b15e747c88749bfb25139f3bd80b395 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:19.445459 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134c862-b2ed-4774-be2c-0c5fa674ec09 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:19.446311 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134c862-b2ed-4774-be2c-0c5fa674ec09 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:19.446741 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134c862-b2ed-4774-be2c-0c5fa674ec09 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:19.448546 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 166/337] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:19.454347 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f161690-2ee2-4f97-94ae-6900f6c6dfd9 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:19.455425 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f161690-2ee2-4f97-94ae-6900f6c6dfd9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:19.455919 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f161690-2ee2-4f97-94ae-6900f6c6dfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:19.475494 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-2f161690-2ee2-4f97-94ae-6900f6c6dfd9 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:19.476996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2f161690-2ee2-4f97-94ae-6900f6c6dfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:19.512684 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:19.547456 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 172/338] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:19.676582 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc11dd-f337-43fe-b5ac-a39f0bdf2736 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:19.677236 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc11dd-f337-43fe-b5ac-a39f0bdf2736 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:19.677709 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc11dd-f337-43fe-b5ac-a39f0bdf2736 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:19.679705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 167/339] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:19.685759 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910a455-66a1-4501-aa07-55cdc82001ee None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:19.686364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910a455-66a1-4501-aa07-55cdc82001ee None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:19.686855 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910a455-66a1-4501-aa07-55cdc82001ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:19.706475 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8910a455-66a1-4501-aa07-55cdc82001ee None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:19.708031 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8910a455-66a1-4501-aa07-55cdc82001ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:19.784251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 173/340] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:19.817967 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2289-d8e4-4f94-b376-c328c4b7d229 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:19.818566 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2289-d8e4-4f94-b376-c328c4b7d229 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:19.819037 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2289-d8e4-4f94-b376-c328c4b7d229 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:19.820584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 168/341] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:19.825981 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cbb6b-d1f1-4953-ae35-faf8e3b28cd3 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:19.826267 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cbb6b-d1f1-4953-ae35-faf8e3b28cd3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:19.826542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cbb6b-d1f1-4953-ae35-faf8e3b28cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:19.845637 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-332cbb6b-d1f1-4953-ae35-faf8e3b28cd3 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:19.846807 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-332cbb6b-d1f1-4953-ae35-faf8e3b28cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:19.887469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2289-d8e4-4f94-b376-c328c4b7d229 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:19.930323 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 174/342] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:20.005417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2289-d8e4-4f94-b376-c328c4b7d229 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:20.041040 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00465892-b488-4a09-a54c-fc2073668623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:20.041877 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00465892-b488-4a09-a54c-fc2073668623 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:20.042317 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00465892-b488-4a09-a54c-fc2073668623 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:20.042729 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00465892-b488-4a09-a54c-fc2073668623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:20.055682 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00465892-b488-4a09-a54c-fc2073668623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:20.057297 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00465892-b488-4a09-a54c-fc2073668623 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-00465892-b488-4a09-a54c-fc2073668623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:20.072344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:20.073491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:20.074540 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:20.074540 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:20.074540 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:20.076205 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 169/343] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:31:20.082528 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cbb6b-d1f1-4953-ae35-faf8e3b28cd3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:20.116087 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:20.120338 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e799d-c201-447b-84cb-cf6c6d0ad9c7 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:20.120866 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e799d-c201-447b-84cb-cf6c6d0ad9c7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:20.121449 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e799d-c201-447b-84cb-cf6c6d0ad9c7 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:20.122963 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 170/344] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:31:20.129107 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449879f-95f8-49a0-a817-9f76d504d023 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:20.129392 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449879f-95f8-49a0-a817-9f76d504d023 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:20.129664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449879f-95f8-49a0-a817-9f76d504d023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:20.149228 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9449879f-95f8-49a0-a817-9f76d504d023 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:20.150395 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9449879f-95f8-49a0-a817-9f76d504d023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:20.186224 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:20.191700 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cbb6b-d1f1-4953-ae35-faf8e3b28cd3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:20.230809 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 171/345] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:31:20.231461 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449879f-95f8-49a0-a817-9f76d504d023 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:20.239978 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a4489-cd08-4aa6-9c4f-0bd4e536b65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:20.241812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a4489-cd08-4aa6-9c4f-0bd4e536b65c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:20.242291 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a4489-cd08-4aa6-9c4f-0bd4e536b65c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:20.242773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a4489-cd08-4aa6-9c4f-0bd4e536b65c None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:20.243669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a4489-cd08-4aa6-9c4f-0bd4e536b65c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:20.246978 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a4489-cd08-4aa6-9c4f-0bd4e536b65c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:20.249324 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a4489-cd08-4aa6-9c4f-0bd4e536b65c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:20.268211 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 175/346] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:20.270124 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a4489-cd08-4aa6-9c4f-0bd4e536b65c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:20.355573 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449879f-95f8-49a0-a817-9f76d504d023 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:20.366676 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:20.376906 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a4489-cd08-4aa6-9c4f-0bd4e536b65c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:20.394564 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a68700-b152-4544-9739-c69d19430080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:20.395192 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a68700-b152-4544-9739-c69d19430080 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:20.395670 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a68700-b152-4544-9739-c69d19430080 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:20.395945 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a68700-b152-4544-9739-c69d19430080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:20.406510 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a68700-b152-4544-9739-c69d19430080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:20.408815 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a68700-b152-4544-9739-c69d19430080 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:20.412166 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b2d17-d7aa-4266-90eb-e92956635477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:20.412803 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b2d17-d7aa-4266-90eb-e92956635477 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:20.413082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b2d17-d7aa-4266-90eb-e92956635477 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:20.413355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b2d17-d7aa-4266-90eb-e92956635477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-17a68700-b152-4544-9739-c69d19430080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:20.425130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:20.426184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:20.427237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:20.427237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:20.427237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:20.427470 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b2d17-d7aa-4266-90eb-e92956635477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:20.427585 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b2d17-d7aa-4266-90eb-e92956635477 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:20.428850 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 172/347] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:20.429507 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a68700-b152-4544-9739-c69d19430080 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-d40b2d17-d7aa-4266-90eb-e92956635477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:20.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:20.448480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:20.449307 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:20.449307 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:20.449307 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:20.449307 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 176/348] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:31:20.449524 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b2d17-d7aa-4266-90eb-e92956635477 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:20.455341 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:20.536090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a68700-b152-4544-9739-c69d19430080 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:20.568543 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b2d17-d7aa-4266-90eb-e92956635477 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:20.572148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38432-466e-4601-a0d5-cc9e4748f69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:20.572804 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38432-466e-4601-a0d5-cc9e4748f69a None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:20.573089 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38432-466e-4601-a0d5-cc9e4748f69a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:20.573362 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38432-466e-4601-a0d5-cc9e4748f69a None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:20.574004 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b38432-466e-4601-a0d5-cc9e4748f69a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:20.575498 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b38432-466e-4601-a0d5-cc9e4748f69a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:20.596751 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 173/349] 10.222.0.40 () {60 vars in 1132 bytes} [Sat Oct 29 20:31:20 2022] POST /identity/v3/users => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:31:20.597550 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38432-466e-4601-a0d5-cc9e4748f69a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:20.615427 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c62483-59d9-4a2f-a96f-f65bd3b5f634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:20.616006 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62483-59d9-4a2f-a96f-f65bd3b5f634 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:20.616284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62483-59d9-4a2f-a96f-f65bd3b5f634 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:20.616558 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62483-59d9-4a2f-a96f-f65bd3b5f634 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:20.617254 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c62483-59d9-4a2f-a96f-f65bd3b5f634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:20.617530 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c62483-59d9-4a2f-a96f-f65bd3b5f634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:20.618980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c62483-59d9-4a2f-a96f-f65bd3b5f634 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:20.632908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 177/350] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:20.633782 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c62483-59d9-4a2f-a96f-f65bd3b5f634 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:20.636651 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:20.697215 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:20.726546 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38432-466e-4601-a0d5-cc9e4748f69a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:20.746817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c62483-59d9-4a2f-a96f-f65bd3b5f634 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:20.764504 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097472b-c90b-4a2e-bad0-5df212ca8805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:20.765316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097472b-c90b-4a2e-bad0-5df212ca8805 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:20.765589 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097472b-c90b-4a2e-bad0-5df212ca8805 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:20.766212 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097472b-c90b-4a2e-bad0-5df212ca8805 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:20.767523 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097472b-c90b-4a2e-bad0-5df212ca8805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:20.767829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097472b-c90b-4a2e-bad0-5df212ca8805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:20.769247 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097472b-c90b-4a2e-bad0-5df212ca8805 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:20.784498 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 174/351] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:20.785368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097472b-c90b-4a2e-bad0-5df212ca8805 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:20.788128 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75db526-8db1-4630-bcf2-ff5a1d5a54e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:20.789412 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75db526-8db1-4630-bcf2-ff5a1d5a54e9 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:20.789732 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75db526-8db1-4630-bcf2-ff5a1d5a54e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:20.790052 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75db526-8db1-4630-bcf2-ff5a1d5a54e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:20.802496 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75db526-8db1-4630-bcf2-ff5a1d5a54e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:20.804092 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75db526-8db1-4630-bcf2-ff5a1d5a54e9 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-b75db526-8db1-4630-bcf2-ff5a1d5a54e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:20.822005 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:20.822940 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:20.823852 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:20.823852 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:20.823852 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:20.823852 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 178/352] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:20.824852 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75db526-8db1-4630-bcf2-ff5a1d5a54e9 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:20.888890 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:20.905616 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097472b-c90b-4a2e-bad0-5df212ca8805 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:20.941013 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75db526-8db1-4630-bcf2-ff5a1d5a54e9 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:20.950207 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2b681-f361-4660-91c2-fc08ec1d9a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:20.951175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2b681-f361-4660-91c2-fc08ec1d9a56 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:20.951489 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2b681-f361-4660-91c2-fc08ec1d9a56 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:20.951762 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2b681-f361-4660-91c2-fc08ec1d9a56 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:20.952729 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2b681-f361-4660-91c2-fc08ec1d9a56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:20.955013 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2b681-f361-4660-91c2-fc08ec1d9a56 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:20.966143 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:20.978800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd9d7d-a165-430d-acdb-92bacadb073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:20.979447 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd9d7d-a165-430d-acdb-92bacadb073a None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:20.979853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 175/353] 10.222.0.40 () {60 vars in 1132 bytes} [Sat Oct 29 20:31:20 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:31:20.980673 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2b681-f361-4660-91c2-fc08ec1d9a56 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:20.987719 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd9d7d-a165-430d-acdb-92bacadb073a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:20.988385 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd9d7d-a165-430d-acdb-92bacadb073a None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:20.989333 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd9d7d-a165-430d-acdb-92bacadb073a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:20.992092 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd9d7d-a165-430d-acdb-92bacadb073a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:21.028405 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 179/354] 10.222.0.40 () {60 vars in 1132 bytes} [Sat Oct 29 20:31:20 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:31:21.124807 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2b681-f361-4660-91c2-fc08ec1d9a56 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:21.166454 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201e406-4405-44a7-bab2-29e394f7d0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:21.167097 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201e406-4405-44a7-bab2-29e394f7d0f7 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:21.167406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201e406-4405-44a7-bab2-29e394f7d0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:21.167680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201e406-4405-44a7-bab2-29e394f7d0f7 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:21.168361 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201e406-4405-44a7-bab2-29e394f7d0f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:21.168663 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201e406-4405-44a7-bab2-29e394f7d0f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:21.170078 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201e406-4405-44a7-bab2-29e394f7d0f7 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:21.185011 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 176/355] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:21.191671 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd9d7d-a165-430d-acdb-92bacadb073a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:21.330444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd9d7d-a165-430d-acdb-92bacadb073a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:21.341496 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:21.369111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c2b1b-91b0-4afa-ac23-025eafa32885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:21.369727 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c2b1b-91b0-4afa-ac23-025eafa32885 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:21.370004 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c2b1b-91b0-4afa-ac23-025eafa32885 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:21.370275 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c2b1b-91b0-4afa-ac23-025eafa32885 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:21.370914 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c2b1b-91b0-4afa-ac23-025eafa32885 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:21.372493 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c2b1b-91b0-4afa-ac23-025eafa32885 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:21.400621 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 180/356] 10.222.0.40 () {60 vars in 1132 bytes} [Sat Oct 29 20:31:21 2022] POST /identity/v3/users => generated 249 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:31:23.086188 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a1748-286e-4de5-aa6a-6748535235bd None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:23.086698 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a1748-286e-4de5-aa6a-6748535235bd None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:23.086805 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a1748-286e-4de5-aa6a-6748535235bd None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:23.088336 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 177/357] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:23.093726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e26fe-baf0-419e-9f12-99d6253d2490 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:23.094128 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e26fe-baf0-419e-9f12-99d6253d2490 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:23.094293 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e26fe-baf0-419e-9f12-99d6253d2490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:23.114354 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c92e26fe-baf0-419e-9f12-99d6253d2490 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:23.115622 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c92e26fe-baf0-419e-9f12-99d6253d2490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:23.196009 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 181/358] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:23.530311 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a1748-286e-4de5-aa6a-6748535235bd None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:23.568841 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e6545-d766-4978-b16d-ed28c00afc68 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:23.569167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e6545-d766-4978-b16d-ed28c00afc68 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:23.569373 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e6545-d766-4978-b16d-ed28c00afc68 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:23.570819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 182/359] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:23.576160 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557571f2-f105-4ee1-a8ab-53d83d356aa0 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:23.576675 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557571f2-f105-4ee1-a8ab-53d83d356aa0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:23.577171 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557571f2-f105-4ee1-a8ab-53d83d356aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:23.593956 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:23.599154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-557571f2-f105-4ee1-a8ab-53d83d356aa0 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:23.600781 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-557571f2-f105-4ee1-a8ab-53d83d356aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:23.644686 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a1748-286e-4de5-aa6a-6748535235bd None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:23.675691 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 183/360] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:23.685061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ac824-b7b7-4c7c-bd5f-ef2f73a6aba3 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:23.685351 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ac824-b7b7-4c7c-bd5f-ef2f73a6aba3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:23.685623 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ac824-b7b7-4c7c-bd5f-ef2f73a6aba3 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:23.686056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2148ea-cd9b-46e2-8d53-b61126179f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:23.686887 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2148ea-cd9b-46e2-8d53-b61126179f93 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:23.687348 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2148ea-cd9b-46e2-8d53-b61126179f93 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:23.687801 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2148ea-cd9b-46e2-8d53-b61126179f93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:23.691656 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 184/361] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:23 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:23.693024 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0346705-31fa-456f-9dc5-d3188539c027 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:23.693313 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0346705-31fa-456f-9dc5-d3188539c027 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:23.693581 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0346705-31fa-456f-9dc5-d3188539c027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:23.703359 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2148ea-cd9b-46e2-8d53-b61126179f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-ba2148ea-cd9b-46e2-8d53-b61126179f93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:23.710917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:23.711864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:23.712619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:23.712619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:23.712619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:23.712619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:23.712619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:23.712619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:23.712619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:23.712619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:23.712619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:23.712619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:23.712619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:23.712619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:23.713749 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c0346705-31fa-456f-9dc5-d3188539c027 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:23.714925 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c0346705-31fa-456f-9dc5-d3188539c027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:23.721118 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 178/362] 10.222.0.40 () {56 vars in 1102 bytes} [Sat Oct 29 20:31:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:23.722148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2148ea-cd9b-46e2-8d53-b61126179f93 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:23.744727 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:23.802653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 185/363] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:23.853779 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2148ea-cd9b-46e2-8d53-b61126179f93 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:23.869172 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:23.886872 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43f42b-f232-4559-ba99-e251203cfa65 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:23.887152 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43f42b-f232-4559-ba99-e251203cfa65 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:23.887464 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43f42b-f232-4559-ba99-e251203cfa65 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:23.889151 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 186/364] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:31:23.893634 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc02c8-4dd6-4436-9014-264522b383ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:23.894394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc02c8-4dd6-4436-9014-264522b383ad None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:23.894845 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc02c8-4dd6-4436-9014-264522b383ad None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:23.895238 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc02c8-4dd6-4436-9014-264522b383ad None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:23.896139 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc02c8-4dd6-4436-9014-264522b383ad None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:23.896587 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc02c8-4dd6-4436-9014-264522b383ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:23.897368 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5e69-6f61-498e-8211-a39eec0d4d22 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:23.897746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5e69-6f61-498e-8211-a39eec0d4d22 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:23.898112 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5e69-6f61-498e-8211-a39eec0d4d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:23.898538 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc02c8-4dd6-4436-9014-264522b383ad None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:23.906886 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 179/365] 10.222.0.40 () {56 vars in 1103 bytes} [Sat Oct 29 20:31:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:23.913293 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc02c8-4dd6-4436-9014-264522b383ad None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:23.917464 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6bbf5e69-6f61-498e-8211-a39eec0d4d22 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:23.919032 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6bbf5e69-6f61-498e-8211-a39eec0d4d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:23.996080 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 187/366] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:31:24.020586 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf5e69-6f61-498e-8211-a39eec0d4d22 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:24.032499 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc02c8-4dd6-4436-9014-264522b383ad None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:24.073911 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f523-d8fe-4b6a-a889-aebfd6e86de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:24.074905 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f523-d8fe-4b6a-a889-aebfd6e86de6 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:24.075190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f523-d8fe-4b6a-a889-aebfd6e86de6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:24.075483 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f523-d8fe-4b6a-a889-aebfd6e86de6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:24.089877 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4f523-d8fe-4b6a-a889-aebfd6e86de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:24.091414 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4f523-d8fe-4b6a-a889-aebfd6e86de6 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-cef4f523-d8fe-4b6a-a889-aebfd6e86de6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:24.106331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:24.107237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:24.108103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:24.108103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:24.108103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:24.108103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 180/367] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:31:24.116932 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f523-d8fe-4b6a-a889-aebfd6e86de6 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:24.121291 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:24.139779 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf5e69-6f61-498e-8211-a39eec0d4d22 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:24.175706 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:24.178620 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8405b56-df81-40eb-8c7f-3935f6d9c553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:24.179508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405b56-df81-40eb-8c7f-3935f6d9c553 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:24.179978 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405b56-df81-40eb-8c7f-3935f6d9c553 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:24.180435 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405b56-df81-40eb-8c7f-3935f6d9c553 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:24.192396 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8405b56-df81-40eb-8c7f-3935f6d9c553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-e8405b56-df81-40eb-8c7f-3935f6d9c553 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:24.197250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:24.198109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:24.198910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:24.198910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:24.198910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:24.198910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:24.198910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:24.198910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:24.198910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:24.198910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:24.198910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:24.198910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:24.198910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:24.198910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:24.198910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 188/368] 10.222.0.40 () {56 vars in 1102 bytes} [Sat Oct 29 20:31:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:31:24.199604 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8405b56-df81-40eb-8c7f-3935f6d9c553 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:24.239950 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f523-d8fe-4b6a-a889-aebfd6e86de6 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:24.280451 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d6e2e-a02a-489f-8abd-21d11dbde4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:24.281167 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6e2e-a02a-489f-8abd-21d11dbde4ed None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:24.281452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6e2e-a02a-489f-8abd-21d11dbde4ed None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:24.281712 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6e2e-a02a-489f-8abd-21d11dbde4ed None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:24.282416 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d6e2e-a02a-489f-8abd-21d11dbde4ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:24.282713 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d6e2e-a02a-489f-8abd-21d11dbde4ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:24.284113 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d6e2e-a02a-489f-8abd-21d11dbde4ed None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:24.301371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 181/369] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:24.301371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d6e2e-a02a-489f-8abd-21d11dbde4ed None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:24.341772 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8405b56-df81-40eb-8c7f-3935f6d9c553 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:24.381730 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a49a2-fb05-4796-838c-4066b1942301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:24.382376 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a49a2-fb05-4796-838c-4066b1942301 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:24.382650 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a49a2-fb05-4796-838c-4066b1942301 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:24.382921 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a49a2-fb05-4796-838c-4066b1942301 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:24.394628 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a49a2-fb05-4796-838c-4066b1942301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:24.397817 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-411a49a2-fb05-4796-838c-4066b1942301 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:24.400209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:24.401089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:24.401861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:24.401861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:24.401861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:24.401861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:24.401861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:24.401861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:24.401861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:24.401861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:24.401861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:24.401861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:24.401861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:24.401861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:24.401861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 189/370] 10.222.0.40 () {56 vars in 1102 bytes} [Sat Oct 29 20:31:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:24.402755 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a49a2-fb05-4796-838c-4066b1942301 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:24.416375 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:24.416676 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d6e2e-a02a-489f-8abd-21d11dbde4ed None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:24.453641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea82080-92fe-4135-a639-eb85289a8e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:24.454847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea82080-92fe-4135-a639-eb85289a8e12 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:24.455126 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea82080-92fe-4135-a639-eb85289a8e12 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:24.455430 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea82080-92fe-4135-a639-eb85289a8e12 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:24.456087 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea82080-92fe-4135-a639-eb85289a8e12 None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:24.456383 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea82080-92fe-4135-a639-eb85289a8e12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:24.457729 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea82080-92fe-4135-a639-eb85289a8e12 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:24.465904 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 182/371] 10.222.0.40 () {56 vars in 1103 bytes} [Sat Oct 29 20:31:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:24.466688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea82080-92fe-4135-a639-eb85289a8e12 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:24.512458 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a49a2-fb05-4796-838c-4066b1942301 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:24.545141 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fed5f2-796b-4fe6-8d81-b1fa83ea6760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:24.545762 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fed5f2-796b-4fe6-8d81-b1fa83ea6760 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:24.546038 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fed5f2-796b-4fe6-8d81-b1fa83ea6760 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:24.546568 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fed5f2-796b-4fe6-8d81-b1fa83ea6760 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:24.554136 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fed5f2-796b-4fe6-8d81-b1fa83ea6760 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:24.555646 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fed5f2-796b-4fe6-8d81-b1fa83ea6760 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:24.568005 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea82080-92fe-4135-a639-eb85289a8e12 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-39fed5f2-796b-4fe6-8d81-b1fa83ea6760 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:31:24.569231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:24.570068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:24.570936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:24.570936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:24.570936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:31:24.570936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:31:24.570936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:31:24.570936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:31:24.570936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:31:24.570936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:31:24.570936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 29 20:31:24.570936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:24.570936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 190/372] 10.222.0.40 () {56 vars in 1093 bytes} [Sat Oct 29 20:31:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:24.571535 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fed5f2-796b-4fe6-8d81-b1fa83ea6760 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:24.605978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b6ebc-8e10-472e-bc8c-839c21a61798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:24.606521 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b6ebc-8e10-472e-bc8c-839c21a61798 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:24.606795 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b6ebc-8e10-472e-bc8c-839c21a61798 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:24.607063 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b6ebc-8e10-472e-bc8c-839c21a61798 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:24.617722 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b6ebc-8e10-472e-bc8c-839c21a61798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-a51b6ebc-8e10-472e-bc8c-839c21a61798 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:24.622978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:24.624022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:24.631086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:24.631086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:24.631086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:24.631086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:24.631086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:24.631086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:24.631086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:24.631086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:24.631086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:24.631086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:24.631086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:24.631086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:24.631086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 183/373] 10.222.0.40 () {56 vars in 1102 bytes} [Sat Oct 29 20:31:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:24.631086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b6ebc-8e10-472e-bc8c-839c21a61798 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:24.636100 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:24.636637 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:24.673593 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fed5f2-796b-4fe6-8d81-b1fa83ea6760 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:24.706875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be6aba-3918-4701-8bcb-89b8fbba6ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:24.707501 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be6aba-3918-4701-8bcb-89b8fbba6ae0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:24.707778 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be6aba-3918-4701-8bcb-89b8fbba6ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:24.708045 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be6aba-3918-4701-8bcb-89b8fbba6ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:24.708698 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be6aba-3918-4701-8bcb-89b8fbba6ae0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:24.708993 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be6aba-3918-4701-8bcb-89b8fbba6ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:24.710371 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be6aba-3918-4701-8bcb-89b8fbba6ae0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:24.718122 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 191/374] 10.222.0.40 () {56 vars in 1103 bytes} [Sat Oct 29 20:31:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:24.718907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be6aba-3918-4701-8bcb-89b8fbba6ae0 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:24.728488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b6ebc-8e10-472e-bc8c-839c21a61798 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:24.763410 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d318c-be6a-462b-a8ff-e7a077daebf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:24.764026 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d318c-be6a-462b-a8ff-e7a077daebf1 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:24.764297 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d318c-be6a-462b-a8ff-e7a077daebf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:24.764568 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d318c-be6a-462b-a8ff-e7a077daebf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:24.774889 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d318c-be6a-462b-a8ff-e7a077daebf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:24.776363 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d318c-be6a-462b-a8ff-e7a077daebf1 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-c31d318c-be6a-462b-a8ff-e7a077daebf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:24.791027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:24.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:24.792839 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:24.792839 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:24.792839 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:24.792839 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 184/375] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:24.793060 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d318c-be6a-462b-a8ff-e7a077daebf1 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:24.820237 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be6aba-3918-4701-8bcb-89b8fbba6ae0 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:24.848902 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:24.856887 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:24.858769 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d44e8-9832-4cc4-a8f0-90905df88dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:24.859409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d44e8-9832-4cc4-a8f0-90905df88dca None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:24.859689 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d44e8-9832-4cc4-a8f0-90905df88dca None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:24.859968 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d44e8-9832-4cc4-a8f0-90905df88dca None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:24.860867 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d44e8-9832-4cc4-a8f0-90905df88dca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:24.861330 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d44e8-9832-4cc4-a8f0-90905df88dca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:24.862824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d44e8-9832-4cc4-a8f0-90905df88dca None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:24.899386 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d318c-be6a-462b-a8ff-e7a077daebf1 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:24.899757 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 192/376] 10.222.0.40 () {56 vars in 1133 bytes} [Sat Oct 29 20:31:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:24.900578 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d44e8-9832-4cc4-a8f0-90905df88dca None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:24.933706 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f157b9c-e1de-49e0-985d-699198323e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:24.934302 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f157b9c-e1de-49e0-985d-699198323e2e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:24.934579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f157b9c-e1de-49e0-985d-699198323e2e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:24.934852 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f157b9c-e1de-49e0-985d-699198323e2e None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:24.935552 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f157b9c-e1de-49e0-985d-699198323e2e None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:24.935854 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f157b9c-e1de-49e0-985d-699198323e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:24.937226 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f157b9c-e1de-49e0-985d-699198323e2e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:24.945675 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 185/377] 10.222.0.40 () {56 vars in 1103 bytes} [Sat Oct 29 20:31:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:24.946451 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f157b9c-e1de-49e0-985d-699198323e2e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:25.001851 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d44e8-9832-4cc4-a8f0-90905df88dca None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:25.036074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f2935-06c6-46da-979e-eb7269656852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:25.036700 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f2935-06c6-46da-979e-eb7269656852 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:25.036972 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f2935-06c6-46da-979e-eb7269656852 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:25.037236 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f2935-06c6-46da-979e-eb7269656852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:25.043755 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f157b9c-e1de-49e0-985d-699198323e2e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:25.047157 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f2935-06c6-46da-979e-eb7269656852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:25.049170 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f2935-06c6-46da-979e-eb7269656852 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-495f2935-06c6-46da-979e-eb7269656852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:25.064062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:25.065409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:25.066457 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:25.066457 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:25.066457 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:25.066457 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 193/378] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:25.066457 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f2935-06c6-46da-979e-eb7269656852 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:25.071466 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:25.084836 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69670343-83f1-4bd8-8fe8-5772e76c2569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:25.085431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69670343-83f1-4bd8-8fe8-5772e76c2569 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:25.085704 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69670343-83f1-4bd8-8fe8-5772e76c2569 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:25.085967 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69670343-83f1-4bd8-8fe8-5772e76c2569 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:25.086598 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69670343-83f1-4bd8-8fe8-5772e76c2569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:25.086893 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69670343-83f1-4bd8-8fe8-5772e76c2569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:25.088301 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69670343-83f1-4bd8-8fe8-5772e76c2569 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:25.099870 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 186/379] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:25.100642 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69670343-83f1-4bd8-8fe8-5772e76c2569 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:25.110766 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:25.171284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f2935-06c6-46da-979e-eb7269656852 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:25.199452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69670343-83f1-4bd8-8fe8-5772e76c2569 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:25.207529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3e2eb-98d1-44ff-9e0d-7adc26af909d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:25.208150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3e2eb-98d1-44ff-9e0d-7adc26af909d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:25.208423 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3e2eb-98d1-44ff-9e0d-7adc26af909d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:25.208686 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3e2eb-98d1-44ff-9e0d-7adc26af909d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:25.218361 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3e2eb-98d1-44ff-9e0d-7adc26af909d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:25.219921 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3e2eb-98d1-44ff-9e0d-7adc26af909d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:25.233820 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedff38-97bf-4119-a1c4-7498e5e7458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:25.234436 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedff38-97bf-4119-a1c4-7498e5e7458b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:25.234709 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedff38-97bf-4119-a1c4-7498e5e7458b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:25.234975 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedff38-97bf-4119-a1c4-7498e5e7458b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-05d3e2eb-98d1-44ff-9e0d-7adc26af909d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:25.237074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:25.238177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:25.243937 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:25.243937 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:25.243937 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:25.243937 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 194/380] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:25.243937 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3e2eb-98d1-44ff-9e0d-7adc26af909d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:25.245937 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedff38-97bf-4119-a1c4-7498e5e7458b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:25.247418 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedff38-97bf-4119-a1c4-7498e5e7458b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-8bedff38-97bf-4119-a1c4-7498e5e7458b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:25.263680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:25.264734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:25.266284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:25.266284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:25.266284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:25.266284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 187/381] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:25.266284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedff38-97bf-4119-a1c4-7498e5e7458b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:25.304869 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:25.340042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:25.349989 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3e2eb-98d1-44ff-9e0d-7adc26af909d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:25.371489 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedff38-97bf-4119-a1c4-7498e5e7458b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:25.383466 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b56ec-5a8f-430a-90e4-ba70f0e07ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:25.384057 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b56ec-5a8f-430a-90e4-ba70f0e07ecb None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:25.384329 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b56ec-5a8f-430a-90e4-ba70f0e07ecb None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:25.384593 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b56ec-5a8f-430a-90e4-ba70f0e07ecb None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:25.385287 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b56ec-5a8f-430a-90e4-ba70f0e07ecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:25.385508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b56ec-5a8f-430a-90e4-ba70f0e07ecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:25.386876 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b56ec-5a8f-430a-90e4-ba70f0e07ecb None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:25.399713 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 195/382] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:25.400309 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b56ec-5a8f-430a-90e4-ba70f0e07ecb None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:25.405664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89423037-0272-4bc6-a1d4-acd7bfeef1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:25.406285 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423037-0272-4bc6-a1d4-acd7bfeef1d9 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:25.406558 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423037-0272-4bc6-a1d4-acd7bfeef1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:25.406824 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423037-0272-4bc6-a1d4-acd7bfeef1d9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:25.415948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89423037-0272-4bc6-a1d4-acd7bfeef1d9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:25.417392 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89423037-0272-4bc6-a1d4-acd7bfeef1d9 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-89423037-0272-4bc6-a1d4-acd7bfeef1d9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:31:25.430983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:25.432016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:25.432885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:25.432885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:25.432885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:31:25.432885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:31:25.432885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:31:25.432885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:31:25.432885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:31:25.432885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:31:25.432885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 29 20:31:25.432885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:25.432885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 188/383] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:31:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:25.433430 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89423037-0272-4bc6-a1d4-acd7bfeef1d9 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:25.503151 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b56ec-5a8f-430a-90e4-ba70f0e07ecb None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:25.527565 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:25.536149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89423037-0272-4bc6-a1d4-acd7bfeef1d9 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:25.536959 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70555b16-5b71-4b48-99d7-515124a88435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:25.537558 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70555b16-5b71-4b48-99d7-515124a88435 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:25.537828 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70555b16-5b71-4b48-99d7-515124a88435 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:25.538093 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70555b16-5b71-4b48-99d7-515124a88435 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:25.538741 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70555b16-5b71-4b48-99d7-515124a88435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:25.539016 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70555b16-5b71-4b48-99d7-515124a88435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:25.540427 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70555b16-5b71-4b48-99d7-515124a88435 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:25.551790 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 196/384] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:25.552570 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70555b16-5b71-4b48-99d7-515124a88435 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:25.564691 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:25.575244 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7229641-a7f5-4d12-9329-4779dd8a8100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:25.575874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7229641-a7f5-4d12-9329-4779dd8a8100 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:25.576149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7229641-a7f5-4d12-9329-4779dd8a8100 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:25.576414 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7229641-a7f5-4d12-9329-4779dd8a8100 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:25.577051 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7229641-a7f5-4d12-9329-4779dd8a8100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:25.577349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7229641-a7f5-4d12-9329-4779dd8a8100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:25.578721 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7229641-a7f5-4d12-9329-4779dd8a8100 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:25.590819 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 189/385] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:25.591813 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7229641-a7f5-4d12-9329-4779dd8a8100 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:25.655320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70555b16-5b71-4b48-99d7-515124a88435 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:25.689261 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f293b9d-01e3-41ca-b468-e880aa639dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:25.689884 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f293b9d-01e3-41ca-b468-e880aa639dd4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:25.690158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f293b9d-01e3-41ca-b468-e880aa639dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:25.690361 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7229641-a7f5-4d12-9329-4779dd8a8100 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:25.690456 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f293b9d-01e3-41ca-b468-e880aa639dd4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:25.697722 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f293b9d-01e3-41ca-b468-e880aa639dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:25.699172 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f293b9d-01e3-41ca-b468-e880aa639dd4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-5f293b9d-01e3-41ca-b468-e880aa639dd4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:31:25.710875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:25.711891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:25.712773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:25.712773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:25.712773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:31:25.712773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:31:25.712773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:31:25.712773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:31:25.712773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:31:25.712773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:31:25.712773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 20:31:25.712773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:25.712773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 197/386] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:31:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:25.712773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f293b9d-01e3-41ca-b468-e880aa639dd4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:25.726480 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2230ce0-162d-4e08-9f27-8621f8f06d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:25.727177 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2230ce0-162d-4e08-9f27-8621f8f06d75 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:25.727495 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2230ce0-162d-4e08-9f27-8621f8f06d75 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:25.727763 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2230ce0-162d-4e08-9f27-8621f8f06d75 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:25.728485 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2230ce0-162d-4e08-9f27-8621f8f06d75 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:25.728780 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2230ce0-162d-4e08-9f27-8621f8f06d75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:25.730212 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2230ce0-162d-4e08-9f27-8621f8f06d75 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:25.767588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 190/387] 10.222.0.40 () {56 vars in 1137 bytes} [Sat Oct 29 20:31:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:25.768461 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2230ce0-162d-4e08-9f27-8621f8f06d75 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:25.782644 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:25.785281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:25.817078 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f293b9d-01e3-41ca-b468-e880aa639dd4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:25.851918 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248de47-dbe8-4eaa-8671-e1d3945769e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:25.852544 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248de47-dbe8-4eaa-8671-e1d3945769e9 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:25.852937 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248de47-dbe8-4eaa-8671-e1d3945769e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:25.853121 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248de47-dbe8-4eaa-8671-e1d3945769e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:25.859909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248de47-dbe8-4eaa-8671-e1d3945769e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:25.861877 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248de47-dbe8-4eaa-8671-e1d3945769e9 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:25.869540 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2230ce0-162d-4e08-9f27-8621f8f06d75 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-b248de47-dbe8-4eaa-8671-e1d3945769e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:31:25.873746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:25.874605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:25.875444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:31:25.875444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:31:25.875444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:31:25.875444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:31:25.875444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:31:25.875444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:31:25.875444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:25.875444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:25.875444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 198/388] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:25.876448 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248de47-dbe8-4eaa-8671-e1d3945769e9 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:25.906631 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd478a-0347-4bf1-a9fa-2df96b861293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:25.907182 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd478a-0347-4bf1-a9fa-2df96b861293 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:25.907987 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd478a-0347-4bf1-a9fa-2df96b861293 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:25.908256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd478a-0347-4bf1-a9fa-2df96b861293 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:25.915055 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd478a-0347-4bf1-a9fa-2df96b861293 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:25.916519 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd478a-0347-4bf1-a9fa-2df96b861293 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-42bd478a-0347-4bf1-a9fa-2df96b861293 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:31:25.928737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:25.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:25.930518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:25.930518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:25.930518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:31:25.930518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:31:25.930518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:31:25.930518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:31:25.930518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:31:25.930518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:31:25.930518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 29 20:31:25.930518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:25.930518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 191/389] 10.222.0.40 () {56 vars in 1102 bytes} [Sat Oct 29 20:31:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:25.931083 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd478a-0347-4bf1-a9fa-2df96b861293 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:25.977190 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248de47-dbe8-4eaa-8671-e1d3945769e9 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:26.002363 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:26.006511 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:26.014118 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1182f-ccb3-459f-91fd-462c71fb3c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:26.014729 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1182f-ccb3-459f-91fd-462c71fb3c12 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:26.015009 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1182f-ccb3-459f-91fd-462c71fb3c12 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:26.015283 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1182f-ccb3-459f-91fd-462c71fb3c12 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:26.016041 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1182f-ccb3-459f-91fd-462c71fb3c12 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:26.016344 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1182f-ccb3-459f-91fd-462c71fb3c12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:26.018303 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1182f-ccb3-459f-91fd-462c71fb3c12 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:26.035451 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd478a-0347-4bf1-a9fa-2df96b861293 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:26.036377 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 199/390] 10.222.0.40 () {56 vars in 1137 bytes} [Sat Oct 29 20:31:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:26.041533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1182f-ccb3-459f-91fd-462c71fb3c12 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:26.069168 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf7b46-f0b6-44f5-ab09-ab7fb765b46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:26.069790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf7b46-f0b6-44f5-ab09-ab7fb765b46e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:26.070067 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf7b46-f0b6-44f5-ab09-ab7fb765b46e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:26.070336 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf7b46-f0b6-44f5-ab09-ab7fb765b46e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:26.081675 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf7b46-f0b6-44f5-ab09-ab7fb765b46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:26.083179 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf7b46-f0b6-44f5-ab09-ab7fb765b46e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-fddf7b46-f0b6-44f5-ab09-ab7fb765b46e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:26.098025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:26.099072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:26.100417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:26.100417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:26.100417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:26.100417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 192/391] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:26.100417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf7b46-f0b6-44f5-ab09-ab7fb765b46e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:26.145144 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1182f-ccb3-459f-91fd-462c71fb3c12 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:26.178863 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb482-b864-4042-8845-76b35a653cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:26.179474 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb482-b864-4042-8845-76b35a653cc6 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:26.179748 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb482-b864-4042-8845-76b35a653cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:26.179941 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb482-b864-4042-8845-76b35a653cc6 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:26.180620 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cb482-b864-4042-8845-76b35a653cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:26.180919 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cb482-b864-4042-8845-76b35a653cc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:26.182364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cb482-b864-4042-8845-76b35a653cc6 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:26.198684 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf7b46-f0b6-44f5-ab09-ab7fb765b46e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:26.199736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 200/392] 10.222.0.40 () {56 vars in 1148 bytes} [Sat Oct 29 20:31:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:26.200525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb482-b864-4042-8845-76b35a653cc6 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:26.223735 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:26.234535 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48446f19-89e5-4f86-b0cb-a8af2a2cb7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:26.235132 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48446f19-89e5-4f86-b0cb-a8af2a2cb7fc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:26.236553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48446f19-89e5-4f86-b0cb-a8af2a2cb7fc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:26.236823 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48446f19-89e5-4f86-b0cb-a8af2a2cb7fc None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:26.237546 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48446f19-89e5-4f86-b0cb-a8af2a2cb7fc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:26.237841 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48446f19-89e5-4f86-b0cb-a8af2a2cb7fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:26.239261 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48446f19-89e5-4f86-b0cb-a8af2a2cb7fc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:26.250899 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:26.262652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 193/393] 10.222.0.40 () {56 vars in 1139 bytes} [Sat Oct 29 20:31:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:26.263509 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48446f19-89e5-4f86-b0cb-a8af2a2cb7fc None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:26.303817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb482-b864-4042-8845-76b35a653cc6 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:26.339174 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062a360-b629-4e46-b6f2-24353739b0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:26.339829 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062a360-b629-4e46-b6f2-24353739b0dd None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:26.340103 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062a360-b629-4e46-b6f2-24353739b0dd None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:26.340374 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062a360-b629-4e46-b6f2-24353739b0dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:26.350772 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062a360-b629-4e46-b6f2-24353739b0dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:26.352242 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062a360-b629-4e46-b6f2-24353739b0dd None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:26.364447 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48446f19-89e5-4f86-b0cb-a8af2a2cb7fc None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-4062a360-b629-4e46-b6f2-24353739b0dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:26.367156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:26.368090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:26.368930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:26.368930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:26.368930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:26.368930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 201/394] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:26.369140 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062a360-b629-4e46-b6f2-24353739b0dd None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:26.399467 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c4d45-973a-4606-9b62-d2f16bf53db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:26.400060 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c4d45-973a-4606-9b62-d2f16bf53db7 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:26.400334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c4d45-973a-4606-9b62-d2f16bf53db7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:26.400599 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c4d45-973a-4606-9b62-d2f16bf53db7 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:26.401232 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c4d45-973a-4606-9b62-d2f16bf53db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:26.401523 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c4d45-973a-4606-9b62-d2f16bf53db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:26.402874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c4d45-973a-4606-9b62-d2f16bf53db7 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:26.414650 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 194/395] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:26.415703 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c4d45-973a-4606-9b62-d2f16bf53db7 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:26.459639 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:26.465138 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:26.468105 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062a360-b629-4e46-b6f2-24353739b0dd None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:26.502477 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293a369-c246-4220-a7bf-4785d18ffaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:26.503128 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293a369-c246-4220-a7bf-4785d18ffaf8 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:26.503444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293a369-c246-4220-a7bf-4785d18ffaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:26.503715 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293a369-c246-4220-a7bf-4785d18ffaf8 None admin] PATH_INFO: `/v3/projects/38c8029f1fc24cd098d360f54c51451d/users/b61b58116d364480aed22b5715f6a78a/roles/116e2c35edcf4173a8d203637a4237e0` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:26.516061 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c4d45-973a-4606-9b62-d2f16bf53db7 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:26.518214 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293a369-c246-4220-a7bf-4785d18ffaf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=38c8029f1fc24cd098d360f54c51451d, user_id=b61b58116d364480aed22b5715f6a78a, role_id=116e2c35edcf4173a8d203637a4237e0)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:26.519692 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293a369-c246-4220-a7bf-4785d18ffaf8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:26.532727 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 202/396] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:31:26 2022] PUT /identity/v3/projects/38c8029f1fc24cd098d360f54c51451d/users/b61b58116d364480aed22b5715f6a78a/roles/116e2c35edcf4173a8d203637a4237e0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:31:26.533574 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293a369-c246-4220-a7bf-4785d18ffaf8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:26.555265 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64ce1a-7b70-4de8-8cb0-d89493111ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:26.555947 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64ce1a-7b70-4de8-8cb0-d89493111ef5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:26.556224 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64ce1a-7b70-4de8-8cb0-d89493111ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:26.556515 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64ce1a-7b70-4de8-8cb0-d89493111ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:26.569915 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64ce1a-7b70-4de8-8cb0-d89493111ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:26.571197 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64ce1a-7b70-4de8-8cb0-d89493111ef5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-1d64ce1a-7b70-4de8-8cb0-d89493111ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:26.587579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:26.588661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:26.594914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:26.594914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:26.594914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:26.594914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 195/397] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:26.594914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64ce1a-7b70-4de8-8cb0-d89493111ef5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:26.654150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293a369-c246-4220-a7bf-4785d18ffaf8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:26.692357 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200079d-2fe5-43dc-ae3f-b771cf7b3448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:26.692976 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200079d-2fe5-43dc-ae3f-b771cf7b3448 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:26.693255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200079d-2fe5-43dc-ae3f-b771cf7b3448 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:26.693522 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200079d-2fe5-43dc-ae3f-b771cf7b3448 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:26.694177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200079d-2fe5-43dc-ae3f-b771cf7b3448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:26.694476 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200079d-2fe5-43dc-ae3f-b771cf7b3448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:26.695932 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200079d-2fe5-43dc-ae3f-b771cf7b3448 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:26.708594 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 203/398] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:26.709463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200079d-2fe5-43dc-ae3f-b771cf7b3448 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:26.713986 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:26.724913 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64ce1a-7b70-4de8-8cb0-d89493111ef5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:26.726148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:26.770631 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49528ce-40e0-4342-a4f4-c4e4062ba291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:26.771621 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49528ce-40e0-4342-a4f4-c4e4062ba291 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:26.771902 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49528ce-40e0-4342-a4f4-c4e4062ba291 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:26.772177 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49528ce-40e0-4342-a4f4-c4e4062ba291 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:26.779464 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49528ce-40e0-4342-a4f4-c4e4062ba291 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:26.781257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49528ce-40e0-4342-a4f4-c4e4062ba291 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b49528ce-40e0-4342-a4f4-c4e4062ba291 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:31:26.794948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:26.796058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:26.797202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:31:26.797202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:31:26.797202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:31:26.797202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:31:26.797202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:31:26.797202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:31:26.797202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:26.797202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:26.797202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 196/399] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:26.798172 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49528ce-40e0-4342-a4f4-c4e4062ba291 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:26.832269 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200079d-2fe5-43dc-ae3f-b771cf7b3448 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:26.870672 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f252a4f-8cad-4c46-93ed-a9c725d6f69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:26.871293 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f252a4f-8cad-4c46-93ed-a9c725d6f69e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:26.871598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f252a4f-8cad-4c46-93ed-a9c725d6f69e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:26.871867 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f252a4f-8cad-4c46-93ed-a9c725d6f69e None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:26.872499 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f252a4f-8cad-4c46-93ed-a9c725d6f69e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:26.872796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f252a4f-8cad-4c46-93ed-a9c725d6f69e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:26.874172 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f252a4f-8cad-4c46-93ed-a9c725d6f69e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:26.890610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 204/400] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:26.890610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f252a4f-8cad-4c46-93ed-a9c725d6f69e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:26.918982 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49528ce-40e0-4342-a4f4-c4e4062ba291 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:26.953507 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd0cd7-0fc7-4341-ae99-d8fb2eb2cd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:26.954187 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0cd7-0fc7-4341-ae99-d8fb2eb2cd75 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:26.954487 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0cd7-0fc7-4341-ae99-d8fb2eb2cd75 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:26.954756 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0cd7-0fc7-4341-ae99-d8fb2eb2cd75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:26.961328 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd0cd7-0fc7-4341-ae99-d8fb2eb2cd75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:26.962776 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd0cd7-0fc7-4341-ae99-d8fb2eb2cd75 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:26.964704 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-52bd0cd7-0fc7-4341-ae99-d8fb2eb2cd75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:31:26.974421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:26.975274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:26.976206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:31:26.976206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:31:26.976206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:31:26.976206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:31:26.976206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:31:26.976206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:31:26.976206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:26.976206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:26.976206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 197/401] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:26.976650 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd0cd7-0fc7-4341-ae99-d8fb2eb2cd75 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:26.991949 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:27.006577 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f252a4f-8cad-4c46-93ed-a9c725d6f69e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:27.043173 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a154afb-fe04-44fa-9341-63e12d4fd068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:27.044067 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a154afb-fe04-44fa-9341-63e12d4fd068 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:27.044176 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a154afb-fe04-44fa-9341-63e12d4fd068 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:27.044442 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a154afb-fe04-44fa-9341-63e12d4fd068 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:27.045185 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a154afb-fe04-44fa-9341-63e12d4fd068 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:27.045430 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a154afb-fe04-44fa-9341-63e12d4fd068 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:27.047137 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a154afb-fe04-44fa-9341-63e12d4fd068 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:27.059986 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 205/402] 10.222.0.40 () {56 vars in 1148 bytes} [Sat Oct 29 20:31:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:27.060963 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a154afb-fe04-44fa-9341-63e12d4fd068 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:27.091258 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd0cd7-0fc7-4341-ae99-d8fb2eb2cd75 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:27.132364 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8432f02-f4ad-49ed-832e-a5f6a1bc04a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:27.133178 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8432f02-f4ad-49ed-832e-a5f6a1bc04a8 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:27.133644 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8432f02-f4ad-49ed-832e-a5f6a1bc04a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:27.134051 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8432f02-f4ad-49ed-832e-a5f6a1bc04a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:27.141318 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8432f02-f4ad-49ed-832e-a5f6a1bc04a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:27.143055 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8432f02-f4ad-49ed-832e-a5f6a1bc04a8 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-c8432f02-f4ad-49ed-832e-a5f6a1bc04a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:31:27.155728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:27.156595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:27.157956 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:31:27.157956 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:31:27.157956 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:31:27.157956 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:31:27.157956 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:31:27.157956 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:31:27.157956 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:27.157956 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:27.157956 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 198/403] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:27.158427 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8432f02-f4ad-49ed-832e-a5f6a1bc04a8 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:27.174230 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a154afb-fe04-44fa-9341-63e12d4fd068 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:27.204464 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:27.212224 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa305cd-f7eb-4ebd-a11b-f22caaeea721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:27.212830 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa305cd-f7eb-4ebd-a11b-f22caaeea721 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:27.213104 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa305cd-f7eb-4ebd-a11b-f22caaeea721 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:27.213371 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa305cd-f7eb-4ebd-a11b-f22caaeea721 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:27.214128 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa305cd-f7eb-4ebd-a11b-f22caaeea721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:27.214443 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa305cd-f7eb-4ebd-a11b-f22caaeea721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:27.215965 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa305cd-f7eb-4ebd-a11b-f22caaeea721 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:27.229241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 206/404] 10.222.0.40 () {56 vars in 1148 bytes} [Sat Oct 29 20:31:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:27.235265 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa305cd-f7eb-4ebd-a11b-f22caaeea721 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:27.242992 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:27.274026 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8432f02-f4ad-49ed-832e-a5f6a1bc04a8 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:27.309472 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80bc99-3837-4ded-b9ac-72ce18ca9463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:27.310123 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80bc99-3837-4ded-b9ac-72ce18ca9463 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:27.310400 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80bc99-3837-4ded-b9ac-72ce18ca9463 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:27.310674 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80bc99-3837-4ded-b9ac-72ce18ca9463 None admin] PATH_INFO: `/v3/projects/38c8029f1fc24cd098d360f54c51451d/users/d3f642ae91e04903ba8bba1eb8a1cea6/roles/116e2c35edcf4173a8d203637a4237e0` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:27.328128 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80bc99-3837-4ded-b9ac-72ce18ca9463 None admin] RBAC: Authorizing `identity:create_grant(project_id=38c8029f1fc24cd098d360f54c51451d, user_id=d3f642ae91e04903ba8bba1eb8a1cea6, role_id=116e2c35edcf4173a8d203637a4237e0)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:27.330401 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80bc99-3837-4ded-b9ac-72ce18ca9463 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:27.351342 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 199/405] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:31:27 2022] PUT /identity/v3/projects/38c8029f1fc24cd098d360f54c51451d/users/d3f642ae91e04903ba8bba1eb8a1cea6/roles/116e2c35edcf4173a8d203637a4237e0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:31:27.351342 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80bc99-3837-4ded-b9ac-72ce18ca9463 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:27.363808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa305cd-f7eb-4ebd-a11b-f22caaeea721 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:27.406038 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80dbc5-8f1e-491c-8337-57e3313607d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:27.406822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80dbc5-8f1e-491c-8337-57e3313607d8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:27.407923 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80dbc5-8f1e-491c-8337-57e3313607d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:27.408347 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80dbc5-8f1e-491c-8337-57e3313607d8 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:27.409329 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80dbc5-8f1e-491c-8337-57e3313607d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:27.409801 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80dbc5-8f1e-491c-8337-57e3313607d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:27.411501 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80dbc5-8f1e-491c-8337-57e3313607d8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:27.430153 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 207/406] 10.222.0.40 () {56 vars in 1148 bytes} [Sat Oct 29 20:31:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:27.431792 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80dbc5-8f1e-491c-8337-57e3313607d8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:27.494064 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80bc99-3837-4ded-b9ac-72ce18ca9463 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:27.500361 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:27.545660 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91e0bf-6246-48dd-96fa-6cf4259f624c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:27.547146 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e0bf-6246-48dd-96fa-6cf4259f624c None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:27.548373 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e0bf-6246-48dd-96fa-6cf4259f624c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:27.548918 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e0bf-6246-48dd-96fa-6cf4259f624c None admin] PATH_INFO: `/v3/projects/38c8029f1fc24cd098d360f54c51451d/users/2a21be7abe924b459ffe156f914e6ff2/roles/116e2c35edcf4173a8d203637a4237e0` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:27.565363 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:27.569329 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80dbc5-8f1e-491c-8337-57e3313607d8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:27.571669 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91e0bf-6246-48dd-96fa-6cf4259f624c None admin] RBAC: Authorizing `identity:create_grant(project_id=38c8029f1fc24cd098d360f54c51451d, user_id=2a21be7abe924b459ffe156f914e6ff2, role_id=116e2c35edcf4173a8d203637a4237e0)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:27.574746 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91e0bf-6246-48dd-96fa-6cf4259f624c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:27.591001 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 200/407] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:31:27 2022] PUT /identity/v3/projects/38c8029f1fc24cd098d360f54c51451d/users/2a21be7abe924b459ffe156f914e6ff2/roles/116e2c35edcf4173a8d203637a4237e0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:31:27.610927 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84f02b-ecc7-450d-9d0d-d14e41c29c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:27.612016 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84f02b-ecc7-450d-9d0d-d14e41c29c80 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:27.612494 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84f02b-ecc7-450d-9d0d-d14e41c29c80 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:27.612749 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84f02b-ecc7-450d-9d0d-d14e41c29c80 None admin] PATH_INFO: `/v3/projects/38c8029f1fc24cd098d360f54c51451d/users/d1a02361a67a4e40b4683042a4439204/roles/116e2c35edcf4173a8d203637a4237e0` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:27.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84f02b-ecc7-450d-9d0d-d14e41c29c80 None admin] RBAC: Authorizing `identity:create_grant(project_id=38c8029f1fc24cd098d360f54c51451d, user_id=d1a02361a67a4e40b4683042a4439204, role_id=116e2c35edcf4173a8d203637a4237e0)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:27.636595 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84f02b-ecc7-450d-9d0d-d14e41c29c80 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:27.655556 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 208/408] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:31:27 2022] PUT /identity/v3/projects/38c8029f1fc24cd098d360f54c51451d/users/d1a02361a67a4e40b4683042a4439204/roles/116e2c35edcf4173a8d203637a4237e0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:31:29.006485 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9986ab-5ef1-4606-8eea-756156dece83 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:29.007035 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9986ab-5ef1-4606-8eea-756156dece83 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:29.007035 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9986ab-5ef1-4606-8eea-756156dece83 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:29.008630 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 201/409] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:29.013888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218813d-3dca-4ec3-b4f2-fedbd74551f9 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:29.014306 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218813d-3dca-4ec3-b4f2-fedbd74551f9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:29.014500 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218813d-3dca-4ec3-b4f2-fedbd74551f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:29.034140 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-3218813d-3dca-4ec3-b4f2-fedbd74551f9 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:29.035357 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3218813d-3dca-4ec3-b4f2-fedbd74551f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:29.105231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 209/410] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:29.437838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9986ab-5ef1-4606-8eea-756156dece83 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:29.550991 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9986ab-5ef1-4606-8eea-756156dece83 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:29.587243 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc922d-8f57-41e4-bcc7-94be667fcf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:29.587900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc922d-8f57-41e4-bcc7-94be667fcf7c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:29.588173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc922d-8f57-41e4-bcc7-94be667fcf7c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:29.588443 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc922d-8f57-41e4-bcc7-94be667fcf7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:29.599772 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc922d-8f57-41e4-bcc7-94be667fcf7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-9edc922d-8f57-41e4-bcc7-94be667fcf7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:29.604723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:29.605601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:29.606382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:29.606382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:29.606382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:29.606382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:29.606382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:29.606382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:29.606382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:29.606382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:29.606382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:29.606382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:29.606382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:29.606382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:29.606382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 202/411] 10.222.0.40 () {56 vars in 1102 bytes} [Sat Oct 29 20:31:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:29.612333 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218813d-3dca-4ec3-b4f2-fedbd74551f9 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:29.643746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:29.727693 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218813d-3dca-4ec3-b4f2-fedbd74551f9 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:29.765884 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b01a0-c8ff-41a3-ae4c-bfd2a8f8cd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:29.767029 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b01a0-c8ff-41a3-ae4c-bfd2a8f8cd6a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:29.767348 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b01a0-c8ff-41a3-ae4c-bfd2a8f8cd6a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:29.767566 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b01a0-c8ff-41a3-ae4c-bfd2a8f8cd6a None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:29.768228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b01a0-c8ff-41a3-ae4c-bfd2a8f8cd6a None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:29.768524 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b01a0-c8ff-41a3-ae4c-bfd2a8f8cd6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:29.769901 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b01a0-c8ff-41a3-ae4c-bfd2a8f8cd6a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:29.778516 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 210/412] 10.222.0.40 () {56 vars in 1103 bytes} [Sat Oct 29 20:31:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:29.785268 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc922d-8f57-41e4-bcc7-94be667fcf7c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:29.828790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:29.902922 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc922d-8f57-41e4-bcc7-94be667fcf7c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:29.939952 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26793a-d259-44e2-abd9-a5d69fd4c5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:29.940580 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26793a-d259-44e2-abd9-a5d69fd4c5d2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:29.940864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26793a-d259-44e2-abd9-a5d69fd4c5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:29.941126 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26793a-d259-44e2-abd9-a5d69fd4c5d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:29.947844 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea67f17-d504-4f5e-a806-939d88dbc43e None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:29.948365 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea67f17-d504-4f5e-a806-939d88dbc43e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:29.948900 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea67f17-d504-4f5e-a806-939d88dbc43e None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:29.950679 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 211/413] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:31:29.954435 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26793a-d259-44e2-abd9-a5d69fd4c5d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:29.954435 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26793a-d259-44e2-abd9-a5d69fd4c5d2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:29.956388 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f99d6-53c7-4d5b-ac13-8ef5f3db1339 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:29.957020 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f99d6-53c7-4d5b-ac13-8ef5f3db1339 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:29.957497 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f99d6-53c7-4d5b-ac13-8ef5f3db1339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-7f26793a-d259-44e2-abd9-a5d69fd4c5d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:29.970413 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:29.971393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:29.972231 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:29.972231 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:29.972231 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:29.972231 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 203/414] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:29.977226 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26793a-d259-44e2-abd9-a5d69fd4c5d2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:29.980386 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-810f99d6-53c7-4d5b-ac13-8ef5f3db1339 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:29.981922 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-810f99d6-53c7-4d5b-ac13-8ef5f3db1339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:30.063812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 212/415] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:31:30.066551 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:30.082338 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26793a-d259-44e2-abd9-a5d69fd4c5d2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:30.116628 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c9b0-6e2d-49bb-a688-408d3e491dd5 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:30.117300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c9b0-6e2d-49bb-a688-408d3e491dd5 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:30.117833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c9b0-6e2d-49bb-a688-408d3e491dd5 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:30.118171 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdea281-811f-425f-b3c5-bddb0fa572e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:30.118776 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdea281-811f-425f-b3c5-bddb0fa572e4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:30.119054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdea281-811f-425f-b3c5-bddb0fa572e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:30.119358 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdea281-811f-425f-b3c5-bddb0fa572e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:30.120010 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdea281-811f-425f-b3c5-bddb0fa572e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:30.120311 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdea281-811f-425f-b3c5-bddb0fa572e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:30.120920 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 213/416] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:31:30.121848 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdea281-811f-425f-b3c5-bddb0fa572e4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:30.130123 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c824c4b-d9bb-40d0-be9a-443448db25bb None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:30.130123 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c824c4b-d9bb-40d0-be9a-443448db25bb None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:30.130123 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c824c4b-d9bb-40d0-be9a-443448db25bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:30.135566 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 204/417] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:30.140711 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdea281-811f-425f-b3c5-bddb0fa572e4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:30.151785 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-5c824c4b-d9bb-40d0-be9a-443448db25bb None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:30.153156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5c824c4b-d9bb-40d0-be9a-443448db25bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:30.171921 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:30.229553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 214/418] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a3adc-b189-468c-995b-322339983fb5 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:30.231152 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a3adc-b189-468c-995b-322339983fb5 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:30.231458 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a3adc-b189-468c-995b-322339983fb5 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:30.235797 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 215/419] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:30.238522 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6925b36-0405-4697-9cb5-3c219e4b93a0 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:30.238969 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6925b36-0405-4697-9cb5-3c219e4b93a0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:30.239414 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6925b36-0405-4697-9cb5-3c219e4b93a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:30.254699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdea281-811f-425f-b3c5-bddb0fa572e4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:30.277069 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-e6925b36-0405-4697-9cb5-3c219e4b93a0 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:30.278415 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e6925b36-0405-4697-9cb5-3c219e4b93a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:30.304046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73ddda-9377-4ec3-afc4-0d7cf356e7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:30.304914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73ddda-9377-4ec3-afc4-0d7cf356e7b2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:30.305337 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73ddda-9377-4ec3-afc4-0d7cf356e7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:30.305750 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73ddda-9377-4ec3-afc4-0d7cf356e7b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:30.316311 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73ddda-9377-4ec3-afc4-0d7cf356e7b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:30.318741 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73ddda-9377-4ec3-afc4-0d7cf356e7b2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-6e73ddda-9377-4ec3-afc4-0d7cf356e7b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:31:30.334349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:30.335588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:30.336488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:30.336488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:30.336488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:31:30.336488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:31:30.336488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:31:30.336488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:31:30.336488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:31:30.336488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:31:30.336488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 29 20:31:30.336488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:30.343231 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 205/420] 10.222.0.40 () {56 vars in 1093 bytes} [Sat Oct 29 20:31:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:31:30.344910 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73ddda-9377-4ec3-afc4-0d7cf356e7b2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:30.357232 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:30.375432 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 216/421] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:30.398247 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6925b36-0405-4697-9cb5-3c219e4b93a0 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:30.484707 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73ddda-9377-4ec3-afc4-0d7cf356e7b2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:30.490286 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:30.509970 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6925b36-0405-4697-9cb5-3c219e4b93a0 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:30.524330 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cadbac-aaeb-4be3-893d-7e553bfcf33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:30.525107 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cadbac-aaeb-4be3-893d-7e553bfcf33c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:30.525351 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cadbac-aaeb-4be3-893d-7e553bfcf33c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:30.525621 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cadbac-aaeb-4be3-893d-7e553bfcf33c None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:30.526340 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cadbac-aaeb-4be3-893d-7e553bfcf33c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:30.526658 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cadbac-aaeb-4be3-893d-7e553bfcf33c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:30.528219 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cadbac-aaeb-4be3-893d-7e553bfcf33c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:30.551950 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 206/422] 10.222.0.40 () {56 vars in 1133 bytes} [Sat Oct 29 20:31:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:30.553052 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4832bb4-4167-42eb-886f-5819d4fefa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:30.553686 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4832bb4-4167-42eb-886f-5819d4fefa45 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:30.553956 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4832bb4-4167-42eb-886f-5819d4fefa45 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:30.554221 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4832bb4-4167-42eb-886f-5819d4fefa45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:30.554427 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cadbac-aaeb-4be3-893d-7e553bfcf33c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:30.569647 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4832bb4-4167-42eb-886f-5819d4fefa45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-a4832bb4-4167-42eb-886f-5819d4fefa45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:30.577036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:30.577909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:30.578726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:30.578726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:30.578726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:30.578726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:30.578726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:30.578726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:30.578726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:30.578726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:30.578726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:30.578726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:30.578726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:30.578726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:30.582654 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 217/423] 10.222.0.40 () {56 vars in 1102 bytes} [Sat Oct 29 20:31:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:30.583608 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4832bb4-4167-42eb-886f-5819d4fefa45 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:30.628382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:30.669356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cadbac-aaeb-4be3-893d-7e553bfcf33c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:30.694226 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4832bb4-4167-42eb-886f-5819d4fefa45 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:30.707342 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6769b-2e21-48e7-96ad-90af5fdff514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:30.707945 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6769b-2e21-48e7-96ad-90af5fdff514 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:30.708233 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6769b-2e21-48e7-96ad-90af5fdff514 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:30.708489 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6769b-2e21-48e7-96ad-90af5fdff514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:30.730007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7896b-8a4f-4265-b75c-33ffccbb330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:30.730646 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7896b-8a4f-4265-b75c-33ffccbb330b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:30.730923 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7896b-8a4f-4265-b75c-33ffccbb330b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:30.731198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7896b-8a4f-4265-b75c-33ffccbb330b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:30.741760 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7896b-8a4f-4265-b75c-33ffccbb330b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-79a7896b-8a4f-4265-b75c-33ffccbb330b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:30.746521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:30.747473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:30.748259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:30.748259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:30.748259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:30.748259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:30.748259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:30.748259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:30.748259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:30.748259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:30.748259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:30.748259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:30.748259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:30.748259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:30.748259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 218/424] 10.222.0.40 () {56 vars in 1102 bytes} [Sat Oct 29 20:31:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:30.748890 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7896b-8a4f-4265-b75c-33ffccbb330b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:30.751648 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:30.780055 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6769b-2e21-48e7-96ad-90af5fdff514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:30.781523 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6769b-2e21-48e7-96ad-90af5fdff514 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:30.846660 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:30.849069 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7896b-8a4f-4265-b75c-33ffccbb330b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:30.882444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c1a96-0738-4946-b70e-fa3b13755129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:30.883040 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c1a96-0738-4946-b70e-fa3b13755129 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:30.883348 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c1a96-0738-4946-b70e-fa3b13755129 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:30.883618 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c1a96-0738-4946-b70e-fa3b13755129 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:30.884268 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c1a96-0738-4946-b70e-fa3b13755129 None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:30.884567 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c1a96-0738-4946-b70e-fa3b13755129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:30.885937 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c1a96-0738-4946-b70e-fa3b13755129 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:30.886884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 207/425] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:31:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 29 20:31:30.887735 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6769b-2e21-48e7-96ad-90af5fdff514 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:30.898472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 219/426] 10.222.0.40 () {56 vars in 1103 bytes} [Sat Oct 29 20:31:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:30.899858 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c1a96-0738-4946-b70e-fa3b13755129 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:30.963704 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:30.988243 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6769b-2e21-48e7-96ad-90af5fdff514 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:31.001686 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c1a96-0738-4946-b70e-fa3b13755129 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:31.021622 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84c1c0-d8dc-4bac-ba06-60f6879a8cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:31.022238 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84c1c0-d8dc-4bac-ba06-60f6879a8cfd None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:31.022513 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84c1c0-d8dc-4bac-ba06-60f6879a8cfd None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:31.022782 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84c1c0-d8dc-4bac-ba06-60f6879a8cfd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:31.032800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84c1c0-d8dc-4bac-ba06-60f6879a8cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:31.034611 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c511df-c238-477a-846a-9f3852db9227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:31.035209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c511df-c238-477a-846a-9f3852db9227 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:31.035519 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c511df-c238-477a-846a-9f3852db9227 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:31.035792 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c511df-c238-477a-846a-9f3852db9227 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:31.036483 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c511df-c238-477a-846a-9f3852db9227 None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:31.036787 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c511df-c238-477a-846a-9f3852db9227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-7f84c1c0-d8dc-4bac-ba06-60f6879a8cfd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:31.037584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:31.038576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:31.044115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:31.044115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:31.044115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:31.044115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:31.044115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:31.044115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:31.044115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:31.044115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:31.044115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:31.044115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:31.044115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:31:31.044115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:31.044713 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c511df-c238-477a-846a-9f3852db9227 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:31.044782 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 208/427] 10.222.0.40 () {56 vars in 1102 bytes} [Sat Oct 29 20:31:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:31.044782 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84c1c0-d8dc-4bac-ba06-60f6879a8cfd None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:31.051103 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 220/428] 10.222.0.40 () {56 vars in 1103 bytes} [Sat Oct 29 20:31:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:31.052018 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c511df-c238-477a-846a-9f3852db9227 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:31.067919 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:31.146083 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84c1c0-d8dc-4bac-ba06-60f6879a8cfd None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:31.152969 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c511df-c238-477a-846a-9f3852db9227 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:31.178708 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:31.180679 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a466b-6d8f-42c6-912c-34a6427c9365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:31.181333 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a466b-6d8f-42c6-912c-34a6427c9365 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:31.181578 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a466b-6d8f-42c6-912c-34a6427c9365 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:31.181853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a466b-6d8f-42c6-912c-34a6427c9365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:31.187695 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad59ea-14c4-449f-a7f3-0dcc7f13d953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:31.188394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad59ea-14c4-449f-a7f3-0dcc7f13d953 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:31.188676 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad59ea-14c4-449f-a7f3-0dcc7f13d953 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:31.188944 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad59ea-14c4-449f-a7f3-0dcc7f13d953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:31.191783 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a466b-6d8f-42c6-912c-34a6427c9365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:31.193224 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a466b-6d8f-42c6-912c-34a6427c9365 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:31.199563 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad59ea-14c4-449f-a7f3-0dcc7f13d953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:31.201019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad59ea-14c4-449f-a7f3-0dcc7f13d953 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-181a466b-6d8f-42c6-912c-34a6427c9365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:31.208190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:31.209048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:31.209906 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:31.209906 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:31.209906 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:31.209906 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 209/429] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:31.210111 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a466b-6d8f-42c6-912c-34a6427c9365 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-a9ad59ea-14c4-449f-a7f3-0dcc7f13d953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:31.217506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:31.218540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:31.219685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:31.219685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:31.219685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:31.219685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 221/430] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:31.219685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad59ea-14c4-449f-a7f3-0dcc7f13d953 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:31.294466 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:31.319584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a466b-6d8f-42c6-912c-34a6427c9365 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:31.322955 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad59ea-14c4-449f-a7f3-0dcc7f13d953 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:31.352367 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92acf6-1fb0-4772-aaba-6cc3b1edea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:31.352985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92acf6-1fb0-4772-aaba-6cc3b1edea7b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:31.353235 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92acf6-1fb0-4772-aaba-6cc3b1edea7b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:31.353507 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92acf6-1fb0-4772-aaba-6cc3b1edea7b None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:31.354160 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92acf6-1fb0-4772-aaba-6cc3b1edea7b None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:31.354459 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92acf6-1fb0-4772-aaba-6cc3b1edea7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:31.355833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c1936-b30b-4476-b41a-edf1ca29996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:31.355959 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92acf6-1fb0-4772-aaba-6cc3b1edea7b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:31.356454 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c1936-b30b-4476-b41a-edf1ca29996f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:31.356728 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c1936-b30b-4476-b41a-edf1ca29996f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:31.356996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c1936-b30b-4476-b41a-edf1ca29996f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:31.364175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 210/431] 10.222.0.40 () {56 vars in 1103 bytes} [Sat Oct 29 20:31:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:31.365014 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92acf6-1fb0-4772-aaba-6cc3b1edea7b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:31.368464 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c1936-b30b-4476-b41a-edf1ca29996f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:31.370329 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c1936-b30b-4476-b41a-edf1ca29996f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-629c1936-b30b-4476-b41a-edf1ca29996f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:31.384424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:31.385426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:31.386264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:31.386264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:31.386264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:31.386264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 222/432] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:31.386741 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c1936-b30b-4476-b41a-edf1ca29996f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:31.420227 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:31.465993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92acf6-1fb0-4772-aaba-6cc3b1edea7b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:31.489752 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c1936-b30b-4476-b41a-edf1ca29996f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:31.500739 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dba7c1-aa51-4b36-84ba-59ee1fd272b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:31.501855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dba7c1-aa51-4b36-84ba-59ee1fd272b7 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:31.502128 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dba7c1-aa51-4b36-84ba-59ee1fd272b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:31.502396 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dba7c1-aa51-4b36-84ba-59ee1fd272b7 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:31.503039 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dba7c1-aa51-4b36-84ba-59ee1fd272b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:31.503366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dba7c1-aa51-4b36-84ba-59ee1fd272b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:31.504728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dba7c1-aa51-4b36-84ba-59ee1fd272b7 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:31.511475 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:31.517279 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 211/433] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:31.518153 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dba7c1-aa51-4b36-84ba-59ee1fd272b7 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:31.529417 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91055769-0a0e-4e13-853e-3add9eb67af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:31.530017 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91055769-0a0e-4e13-853e-3add9eb67af0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:31.530290 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91055769-0a0e-4e13-853e-3add9eb67af0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:31.530555 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91055769-0a0e-4e13-853e-3add9eb67af0 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:31.531187 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91055769-0a0e-4e13-853e-3add9eb67af0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:31.531510 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91055769-0a0e-4e13-853e-3add9eb67af0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:31.533416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91055769-0a0e-4e13-853e-3add9eb67af0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:31.545008 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 223/434] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:31.546079 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91055769-0a0e-4e13-853e-3add9eb67af0 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:31.619683 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dba7c1-aa51-4b36-84ba-59ee1fd272b7 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:31.636947 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:31.647234 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91055769-0a0e-4e13-853e-3add9eb67af0 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:31.652595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bdd01-ca85-40c7-b12e-20f820176e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:31.653318 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bdd01-ca85-40c7-b12e-20f820176e7f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:31.653691 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bdd01-ca85-40c7-b12e-20f820176e7f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:31.654017 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bdd01-ca85-40c7-b12e-20f820176e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:31.665186 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bdd01-ca85-40c7-b12e-20f820176e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:31.666645 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bdd01-ca85-40c7-b12e-20f820176e7f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:31.682111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a96b2-da4e-406b-a54a-605651c4ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-777bdd01-ca85-40c7-b12e-20f820176e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:31.682354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:31.683229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:31.684120 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:31.684120 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:31.684120 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:31.684277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a96b2-da4e-406b-a54a-605651c4ccea None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:31.684277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a96b2-da4e-406b-a54a-605651c4ccea None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:31.684277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a96b2-da4e-406b-a54a-605651c4ccea None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:31.684452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 212/435] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:31.684515 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a96b2-da4e-406b-a54a-605651c4ccea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:31.684515 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a96b2-da4e-406b-a54a-605651c4ccea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:31.684634 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bdd01-ca85-40c7-b12e-20f820176e7f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:31.685534 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a96b2-da4e-406b-a54a-605651c4ccea None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:31.698492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 224/436] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:31.699576 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a96b2-da4e-406b-a54a-605651c4ccea None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:31.738427 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:31.789274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bdd01-ca85-40c7-b12e-20f820176e7f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:31.798758 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a96b2-da4e-406b-a54a-605651c4ccea None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:31.822753 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ce1d7-7cb2-4767-967c-f562ab74ef0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:31.823397 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce1d7-7cb2-4767-967c-f562ab74ef0f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:31.823670 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce1d7-7cb2-4767-967c-f562ab74ef0f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:31.823934 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce1d7-7cb2-4767-967c-f562ab74ef0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:31.830840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ce1d7-7cb2-4767-967c-f562ab74ef0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:31.832256 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87734a-f6a5-4f99-bf4f-dac4734336cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:31.832380 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ce1d7-7cb2-4767-967c-f562ab74ef0f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:31.832878 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87734a-f6a5-4f99-bf4f-dac4734336cf None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:31.833152 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87734a-f6a5-4f99-bf4f-dac4734336cf None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:31.833465 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87734a-f6a5-4f99-bf4f-dac4734336cf None admin] PATH_INFO: `/v3/users/glance` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:31.840783 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87734a-f6a5-4f99-bf4f-dac4734336cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:31.842199 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87734a-f6a5-4f99-bf4f-dac4734336cf None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-c52ce1d7-7cb2-4767-967c-f562ab74ef0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:31:31.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:31.844145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:31.845112 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:31:31.845112 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:31:31.845112 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:31:31.845112 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:31:31.845112 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:31:31.845112 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:31:31.845112 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:31.845112 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:31.845112 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 213/437] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:31.845564 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ce1d7-7cb2-4767-967c-f562ab74ef0f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-9d87734a-f6a5-4f99-bf4f-dac4734336cf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:31:31.858073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:31.859060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:31.859999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:31.859999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:31.859999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:31:31.859999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:31:31.859999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:31:31.859999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:31:31.859999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:31:31.859999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:31:31.859999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 29 20:31:31.859999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:31.859999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 225/438] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:31:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:31.859999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87734a-f6a5-4f99-bf4f-dac4734336cf None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:31.874062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:31.949774 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ce1d7-7cb2-4767-967c-f562ab74ef0f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:31.959764 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:31.961345 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87734a-f6a5-4f99-bf4f-dac4734336cf None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:31.982353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99eb369-a8a8-415e-baaf-a8e1b589cadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:31.982946 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99eb369-a8a8-415e-baaf-a8e1b589cadd None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:31.983216 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99eb369-a8a8-415e-baaf-a8e1b589cadd None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:31.983517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99eb369-a8a8-415e-baaf-a8e1b589cadd None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:31.984149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99eb369-a8a8-415e-baaf-a8e1b589cadd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:31.984445 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99eb369-a8a8-415e-baaf-a8e1b589cadd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:31.986567 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99eb369-a8a8-415e-baaf-a8e1b589cadd None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:31.994068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64fe9d-17c6-47ca-820b-7b2000f64e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:31.994681 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64fe9d-17c6-47ca-820b-7b2000f64e27 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:31.994954 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64fe9d-17c6-47ca-820b-7b2000f64e27 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:31.995216 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64fe9d-17c6-47ca-820b-7b2000f64e27 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:32.003163 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 214/439] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:32.003163 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99eb369-a8a8-415e-baaf-a8e1b589cadd None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:32.004223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64fe9d-17c6-47ca-820b-7b2000f64e27 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:32.005666 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64fe9d-17c6-47ca-820b-7b2000f64e27 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-de64fe9d-17c6-47ca-820b-7b2000f64e27 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:31:32.016915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:32.022822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:32.024019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:32.024019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:32.024019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:31:32.024019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:31:32.024019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:31:32.024019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:31:32.024019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:31:32.024019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:31:32.024019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 20:31:32.024019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:32.024019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 226/440] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:31:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:32.024019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64fe9d-17c6-47ca-820b-7b2000f64e27 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:32.086833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:32.104544 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99eb369-a8a8-415e-baaf-a8e1b589cadd None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:32.118274 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64fe9d-17c6-47ca-820b-7b2000f64e27 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:32.138903 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6fb22-9964-458b-ab90-3fe190e5ee08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:32.139530 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6fb22-9964-458b-ab90-3fe190e5ee08 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:32.139806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6fb22-9964-458b-ab90-3fe190e5ee08 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:32.140073 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6fb22-9964-458b-ab90-3fe190e5ee08 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:32.140754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6fb22-9964-458b-ab90-3fe190e5ee08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:32.141273 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6fb22-9964-458b-ab90-3fe190e5ee08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:32.143066 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6fb22-9964-458b-ab90-3fe190e5ee08 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:32.151656 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f0e50-7578-4c42-8c22-a6a1940fe5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:32.152247 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0e50-7578-4c42-8c22-a6a1940fe5cf None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:32.152520 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0e50-7578-4c42-8c22-a6a1940fe5cf None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:32.152786 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0e50-7578-4c42-8c22-a6a1940fe5cf None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:32.153499 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f0e50-7578-4c42-8c22-a6a1940fe5cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:32.154015 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f0e50-7578-4c42-8c22-a6a1940fe5cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:32.155193 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f0e50-7578-4c42-8c22-a6a1940fe5cf None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:32.160366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 215/441] 10.222.0.40 () {56 vars in 1148 bytes} [Sat Oct 29 20:31:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:32.161164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6fb22-9964-458b-ab90-3fe190e5ee08 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:32.177622 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 227/442] 10.222.0.40 () {56 vars in 1137 bytes} [Sat Oct 29 20:31:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:32.177622 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f0e50-7578-4c42-8c22-a6a1940fe5cf None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:32.193629 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:32.266258 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6fb22-9964-458b-ab90-3fe190e5ee08 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:32.275020 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f0e50-7578-4c42-8c22-a6a1940fe5cf None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:32.301346 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf2537-bc93-490c-8e86-e7934d7d3c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:32.301971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf2537-bc93-490c-8e86-e7934d7d3c06 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:32.302250 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf2537-bc93-490c-8e86-e7934d7d3c06 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:32.302519 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf2537-bc93-490c-8e86-e7934d7d3c06 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:32.305029 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:32.310281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf2537-bc93-490c-8e86-e7934d7d3c06 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:32.311763 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf2537-bc93-490c-8e86-e7934d7d3c06 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:32.313837 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09f8e1-a0a0-455a-a729-3d81de543d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:32.314444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f8e1-a0a0-455a-a729-3d81de543d77 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:32.314719 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f8e1-a0a0-455a-a729-3d81de543d77 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:32.314989 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f8e1-a0a0-455a-a729-3d81de543d77 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:32.315740 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09f8e1-a0a0-455a-a729-3d81de543d77 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:32.316043 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09f8e1-a0a0-455a-a729-3d81de543d77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:32.317491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09f8e1-a0a0-455a-a729-3d81de543d77 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-03cf2537-bc93-490c-8e86-e7934d7d3c06 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:31:32.322914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:32.323999 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:32.324879 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:32.324879 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:32.324879 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:31:32.324879 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:31:32.324879 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:31:32.324879 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:31:32.324879 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:31:32.324879 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:31:32.324879 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 29 20:31:32.324879 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:32.324879 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 216/443] 10.222.0.40 () {56 vars in 1102 bytes} [Sat Oct 29 20:31:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:32.325417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf2537-bc93-490c-8e86-e7934d7d3c06 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:32.336775 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 228/444] 10.222.0.40 () {56 vars in 1137 bytes} [Sat Oct 29 20:31:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:32.337641 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09f8e1-a0a0-455a-a729-3d81de543d77 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:32.421823 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:32.432036 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf2537-bc93-490c-8e86-e7934d7d3c06 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:32.435241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09f8e1-a0a0-455a-a729-3d81de543d77 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:32.466210 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a609a-f5c1-4921-b5ef-3fd45b453b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:32.466904 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a609a-f5c1-4921-b5ef-3fd45b453b40 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:32.467271 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a609a-f5c1-4921-b5ef-3fd45b453b40 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:32.467637 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a609a-f5c1-4921-b5ef-3fd45b453b40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:32.468428 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a609a-f5c1-4921-b5ef-3fd45b453b40 None admin] RBAC: Adding query filter params (role.id=116e2c35edcf4173a8d203637a4237e0, scope.project.id=38c8029f1fc24cd098d360f54c51451d, user.id=b61b58116d364480aed22b5715f6a78a) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:32.468805 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a609a-f5c1-4921-b5ef-3fd45b453b40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:32.470060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659da02-1700-4dd2-ab28-1e3edede031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:32.470970 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a609a-f5c1-4921-b5ef-3fd45b453b40 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:32.471216 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659da02-1700-4dd2-ab28-1e3edede031e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:32.471522 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659da02-1700-4dd2-ab28-1e3edede031e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:32.471788 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659da02-1700-4dd2-ab28-1e3edede031e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:32.477006 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 217/445] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:31:32 2022] GET /identity/v3/role_assignments?user.id=b61b58116d364480aed22b5715f6a78a&scope.project.id=38c8029f1fc24cd098d360f54c51451d&role.id=116e2c35edcf4173a8d203637a4237e0 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:32.477775 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a609a-f5c1-4921-b5ef-3fd45b453b40 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:32.542843 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:32.559749 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659da02-1700-4dd2-ab28-1e3edede031e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:32.561605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659da02-1700-4dd2-ab28-1e3edede031e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:32.600929 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a609a-f5c1-4921-b5ef-3fd45b453b40 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:32.638121 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe28ee8-cc5a-4bf6-b71c-1df3667fe688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:32.638736 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe28ee8-cc5a-4bf6-b71c-1df3667fe688 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:32.639589 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe28ee8-cc5a-4bf6-b71c-1df3667fe688 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:32.639864 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe28ee8-cc5a-4bf6-b71c-1df3667fe688 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:32.640608 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe28ee8-cc5a-4bf6-b71c-1df3667fe688 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:32.640909 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe28ee8-cc5a-4bf6-b71c-1df3667fe688 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:32.643128 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe28ee8-cc5a-4bf6-b71c-1df3667fe688 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:32.671845 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 218/446] 10.222.0.40 () {56 vars in 1139 bytes} [Sat Oct 29 20:31:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:32.673603 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe28ee8-cc5a-4bf6-b71c-1df3667fe688 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:32.687818 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 229/447] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:31:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:31:32.689301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659da02-1700-4dd2-ab28-1e3edede031e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:32.691336 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:32.784172 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:32.794540 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe28ee8-cc5a-4bf6-b71c-1df3667fe688 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:32.800793 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659da02-1700-4dd2-ab28-1e3edede031e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:32.832112 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc830d-f0c5-4e74-8a1d-b3b15242fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:32.832738 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc830d-f0c5-4e74-8a1d-b3b15242fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:32.833010 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc830d-f0c5-4e74-8a1d-b3b15242fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:32.833275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc830d-f0c5-4e74-8a1d-b3b15242fdb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:32.840022 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51fd6f-11ef-4981-aeb2-ff50c2ffb505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:32.840631 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51fd6f-11ef-4981-aeb2-ff50c2ffb505 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:32.840909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51fd6f-11ef-4981-aeb2-ff50c2ffb505 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:32.841179 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51fd6f-11ef-4981-aeb2-ff50c2ffb505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:32.903660 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc830d-f0c5-4e74-8a1d-b3b15242fdb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:32.905114 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc830d-f0c5-4e74-8a1d-b3b15242fdb7 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:32.914725 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51fd6f-11ef-4981-aeb2-ff50c2ffb505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:32.916363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51fd6f-11ef-4981-aeb2-ff50c2ffb505 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:32.919110 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:33.007887 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:33.015800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 219/448] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:31:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:31:33.017245 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc830d-f0c5-4e74-8a1d-b3b15242fdb7 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:33.030992 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 230/449] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:31:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 20:31:33.036310 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51fd6f-11ef-4981-aeb2-ff50c2ffb505 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:33.130878 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc830d-f0c5-4e74-8a1d-b3b15242fdb7 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:33.140470 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51fd6f-11ef-4981-aeb2-ff50c2ffb505 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:33.145844 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:33.170316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a4863-1782-47fd-93d4-2153e9b8fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:33.171181 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a4863-1782-47fd-93d4-2153e9b8fc85 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:33.171756 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a4863-1782-47fd-93d4-2153e9b8fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:33.172030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a4863-1782-47fd-93d4-2153e9b8fc85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:33.176408 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8214e-845a-406d-8394-27c14ffa7a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:33.177570 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8214e-845a-406d-8394-27c14ffa7a2a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:33.178063 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8214e-845a-406d-8394-27c14ffa7a2a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:33.178528 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8214e-845a-406d-8394-27c14ffa7a2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:33.182637 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a4863-1782-47fd-93d4-2153e9b8fc85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:33.184135 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a4863-1782-47fd-93d4-2153e9b8fc85 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:33.190103 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8214e-845a-406d-8394-27c14ffa7a2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:33.191844 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8214e-845a-406d-8394-27c14ffa7a2a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-ed3a4863-1782-47fd-93d4-2153e9b8fc85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:33.200425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:33.201326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:33.207061 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:33.207061 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:33.207061 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:33.207061 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 220/450] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:33.207061 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a4863-1782-47fd-93d4-2153e9b8fc85 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-eaa8214e-845a-406d-8394-27c14ffa7a2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:33.210061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:33.210886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:33.211779 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:33.211779 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:33.211779 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:33.215692 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 231/451] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:33.216609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8214e-845a-406d-8394-27c14ffa7a2a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:33.266023 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:33.316877 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a4863-1782-47fd-93d4-2153e9b8fc85 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:33.333587 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8214e-845a-406d-8394-27c14ffa7a2a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:33.352471 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf4d3e-007b-48f4-9f63-9a8a9d165dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:33.353338 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4d3e-007b-48f4-9f63-9a8a9d165dc3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:33.353448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4d3e-007b-48f4-9f63-9a8a9d165dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:33.353719 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4d3e-007b-48f4-9f63-9a8a9d165dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:33.366410 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf4d3e-007b-48f4-9f63-9a8a9d165dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:33.367336 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcfe0f-d881-4acc-8b3f-15de869e6262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:33.367941 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcfe0f-d881-4acc-8b3f-15de869e6262 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:33.368041 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf4d3e-007b-48f4-9f63-9a8a9d165dc3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:33.368217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcfe0f-d881-4acc-8b3f-15de869e6262 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:33.368488 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcfe0f-d881-4acc-8b3f-15de869e6262 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:33.369117 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcfe0f-d881-4acc-8b3f-15de869e6262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:33.369418 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcfe0f-d881-4acc-8b3f-15de869e6262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:33.370774 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcfe0f-d881-4acc-8b3f-15de869e6262 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:33.386725 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 232/452] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-adcf4d3e-007b-48f4-9f63-9a8a9d165dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:33.386881 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:33.388275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:33.389105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:33.389105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:33.389105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:33.389268 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcfe0f-d881-4acc-8b3f-15de869e6262 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:33.389336 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 221/453] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:33.389336 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf4d3e-007b-48f4-9f63-9a8a9d165dc3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:33.412808 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:33.488730 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:33.493074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcfe0f-d881-4acc-8b3f-15de869e6262 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:33.497867 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf4d3e-007b-48f4-9f63-9a8a9d165dc3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:33.530883 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1bdf0-f698-4ac2-9fc3-65fd41feeb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:33.531514 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1bdf0-f698-4ac2-9fc3-65fd41feeb40 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:33.531792 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1bdf0-f698-4ac2-9fc3-65fd41feeb40 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:33.532256 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1bdf0-f698-4ac2-9fc3-65fd41feeb40 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:33.532773 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bd9ad-0d4d-461f-a05a-7cbd61176990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:33.532916 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1bdf0-f698-4ac2-9fc3-65fd41feeb40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:33.533178 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1bdf0-f698-4ac2-9fc3-65fd41feeb40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:33.533646 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bd9ad-0d4d-461f-a05a-7cbd61176990 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:33.534014 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bd9ad-0d4d-461f-a05a-7cbd61176990 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:33.534373 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bd9ad-0d4d-461f-a05a-7cbd61176990 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:33.534565 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1bdf0-f698-4ac2-9fc3-65fd41feeb40 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:33.541330 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bd9ad-0d4d-461f-a05a-7cbd61176990 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:33.542734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bd9ad-0d4d-461f-a05a-7cbd61176990 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:33.551375 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 233/454] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:33.551375 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1bdf0-f698-4ac2-9fc3-65fd41feeb40 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-ee4bd9ad-0d4d-461f-a05a-7cbd61176990 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:31:33.554790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:33.555699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:33.561638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:31:33.561638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:31:33.561638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:31:33.561638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:31:33.561638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:31:33.561638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:31:33.561638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:33.561638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:33.561638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 222/455] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:31:33.561638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bd9ad-0d4d-461f-a05a-7cbd61176990 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:33.647893 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:33.661565 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1bdf0-f698-4ac2-9fc3-65fd41feeb40 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:33.671635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bd9ad-0d4d-461f-a05a-7cbd61176990 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:33.702487 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39c794-17b8-4e48-a046-9713d6b22294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:33.703096 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39c794-17b8-4e48-a046-9713d6b22294 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:33.703405 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39c794-17b8-4e48-a046-9713d6b22294 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:33.703674 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39c794-17b8-4e48-a046-9713d6b22294 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:33.704373 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39c794-17b8-4e48-a046-9713d6b22294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:33.704675 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39c794-17b8-4e48-a046-9713d6b22294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:33.706156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39c794-17b8-4e48-a046-9713d6b22294 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:33.708278 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a0d3c-b365-492b-84c1-f762572bd1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:33.708909 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a0d3c-b365-492b-84c1-f762572bd1d2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:33.709187 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a0d3c-b365-492b-84c1-f762572bd1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:33.709461 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a0d3c-b365-492b-84c1-f762572bd1d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:33.716744 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a0d3c-b365-492b-84c1-f762572bd1d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:33.718184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a0d3c-b365-492b-84c1-f762572bd1d2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:33.723618 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 234/456] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:33.723618 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39c794-17b8-4e48-a046-9713d6b22294 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-4f8a0d3c-b365-492b-84c1-f762572bd1d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:31:33.735452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:33.736554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:33.737356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:31:33.737356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:31:33.737356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:31:33.737356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:31:33.737356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:31:33.737356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:31:33.737356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:33.737356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:33.737356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 223/457] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:33.737356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a0d3c-b365-492b-84c1-f762572bd1d2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:33.745669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:33.844106 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a0d3c-b365-492b-84c1-f762572bd1d2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:33.844304 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39c794-17b8-4e48-a046-9713d6b22294 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:33.880994 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbade1e3-eed7-4fd5-822e-3c8cecc9bb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:33.881615 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbade1e3-eed7-4fd5-822e-3c8cecc9bb5a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:33.881890 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbade1e3-eed7-4fd5-822e-3c8cecc9bb5a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:33.882162 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbade1e3-eed7-4fd5-822e-3c8cecc9bb5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:33.883465 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deda37-4fd8-4b26-95c6-1889bee4994d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:33.884344 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deda37-4fd8-4b26-95c6-1889bee4994d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:33.884814 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:33.885830 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deda37-4fd8-4b26-95c6-1889bee4994d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:33.886342 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deda37-4fd8-4b26-95c6-1889bee4994d None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:33.887243 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deda37-4fd8-4b26-95c6-1889bee4994d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:33.887752 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deda37-4fd8-4b26-95c6-1889bee4994d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:33.889327 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbade1e3-eed7-4fd5-822e-3c8cecc9bb5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:33.890464 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deda37-4fd8-4b26-95c6-1889bee4994d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:33.891106 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbade1e3-eed7-4fd5-822e-3c8cecc9bb5a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-cbade1e3-eed7-4fd5-822e-3c8cecc9bb5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:31:33.907417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:33.908282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:33.909101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:31:33.909101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:31:33.909101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:31:33.909101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:31:33.909101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:31:33.909101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:31:33.909101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:33.909101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:33.909101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 224/459] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:33.909101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbade1e3-eed7-4fd5-822e-3c8cecc9bb5a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:33.909605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 235/459] 10.222.0.40 () {56 vars in 1148 bytes} [Sat Oct 29 20:31:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:33.911760 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deda37-4fd8-4b26-95c6-1889bee4994d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:33.992935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:34.017913 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deda37-4fd8-4b26-95c6-1889bee4994d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:34.018519 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbade1e3-eed7-4fd5-822e-3c8cecc9bb5a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:34.053139 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd92c42-4954-4950-b714-e0e796bb538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:34.053411 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a208a0c-794a-47c8-8361-388d5d86a9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:34.053744 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92c42-4954-4950-b714-e0e796bb538e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:34.053983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a208a0c-794a-47c8-8361-388d5d86a9bc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:34.054082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92c42-4954-4950-b714-e0e796bb538e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:34.054259 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a208a0c-794a-47c8-8361-388d5d86a9bc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:34.054364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92c42-4954-4950-b714-e0e796bb538e None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:34.054520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a208a0c-794a-47c8-8361-388d5d86a9bc None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:34.054950 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd92c42-4954-4950-b714-e0e796bb538e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:34.055204 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a208a0c-794a-47c8-8361-388d5d86a9bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:34.055295 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd92c42-4954-4950-b714-e0e796bb538e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:34.055555 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a208a0c-794a-47c8-8361-388d5d86a9bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:34.056706 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd92c42-4954-4950-b714-e0e796bb538e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:34.056981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a208a0c-794a-47c8-8361-388d5d86a9bc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:34.078073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 236/460] 10.222.0.40 () {56 vars in 1148 bytes} [Sat Oct 29 20:31:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:34.078249 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 225/461] 10.222.0.40 () {56 vars in 1148 bytes} [Sat Oct 29 20:31:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:34.078358 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd92c42-4954-4950-b714-e0e796bb538e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:34.078458 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a208a0c-794a-47c8-8361-388d5d86a9bc None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:34.140054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:34.175548 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd92c42-4954-4950-b714-e0e796bb538e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:34.189308 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a208a0c-794a-47c8-8361-388d5d86a9bc None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:34.212877 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b8247-4760-49c9-a9d8-e34cf4f4e15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:34.214626 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b8247-4760-49c9-a9d8-e34cf4f4e15b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:34.215391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b8247-4760-49c9-a9d8-e34cf4f4e15b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:34.215811 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b8247-4760-49c9-a9d8-e34cf4f4e15b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:34.217408 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b8247-4760-49c9-a9d8-e34cf4f4e15b None admin] RBAC: Adding query filter params (role.id=116e2c35edcf4173a8d203637a4237e0, scope.project.id=38c8029f1fc24cd098d360f54c51451d, user.id=d3f642ae91e04903ba8bba1eb8a1cea6) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:34.217868 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b8247-4760-49c9-a9d8-e34cf4f4e15b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:34.220496 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b8247-4760-49c9-a9d8-e34cf4f4e15b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:34.227941 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d606716-9c06-412b-bfc0-ba8c0dd61216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:34.235516 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d606716-9c06-412b-bfc0-ba8c0dd61216 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:34.235516 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d606716-9c06-412b-bfc0-ba8c0dd61216 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:34.235516 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d606716-9c06-412b-bfc0-ba8c0dd61216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:34.235516 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d606716-9c06-412b-bfc0-ba8c0dd61216 None admin] RBAC: Adding query filter params (role.id=116e2c35edcf4173a8d203637a4237e0, scope.project.id=38c8029f1fc24cd098d360f54c51451d, user.id=2a21be7abe924b459ffe156f914e6ff2) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:34.235516 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d606716-9c06-412b-bfc0-ba8c0dd61216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:34.236666 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 237/462] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:31:34 2022] GET /identity/v3/role_assignments?user.id=d3f642ae91e04903ba8bba1eb8a1cea6&scope.project.id=38c8029f1fc24cd098d360f54c51451d&role.id=116e2c35edcf4173a8d203637a4237e0 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:34.236666 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b8247-4760-49c9-a9d8-e34cf4f4e15b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:34.237900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d606716-9c06-412b-bfc0-ba8c0dd61216 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:34.237992 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:34.256893 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 226/463] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:31:34 2022] GET /identity/v3/role_assignments?user.id=2a21be7abe924b459ffe156f914e6ff2&scope.project.id=38c8029f1fc24cd098d360f54c51451d&role.id=116e2c35edcf4173a8d203637a4237e0 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:34.388513 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b8247-4760-49c9-a9d8-e34cf4f4e15b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:34.434963 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68510d5-ce41-4413-ab6f-64c62274ab23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:34.435637 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68510d5-ce41-4413-ab6f-64c62274ab23 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:34.435915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68510d5-ce41-4413-ab6f-64c62274ab23 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:34.436259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68510d5-ce41-4413-ab6f-64c62274ab23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:34.437026 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68510d5-ce41-4413-ab6f-64c62274ab23 None admin] RBAC: Adding query filter params (role.id=116e2c35edcf4173a8d203637a4237e0, scope.project.id=38c8029f1fc24cd098d360f54c51451d, user.id=d1a02361a67a4e40b4683042a4439204) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:34.437331 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68510d5-ce41-4413-ab6f-64c62274ab23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:34.440370 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68510d5-ce41-4413-ab6f-64c62274ab23 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:34.449443 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 238/464] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:31:34 2022] GET /identity/v3/role_assignments?user.id=d1a02361a67a4e40b4683042a4439204&scope.project.id=38c8029f1fc24cd098d360f54c51451d&role.id=116e2c35edcf4173a8d203637a4237e0 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:35.007892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5e3ac-86cd-447f-93e5-3e65cee336ae None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:35.008399 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5e3ac-86cd-447f-93e5-3e65cee336ae None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:35.008553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5e3ac-86cd-447f-93e5-3e65cee336ae None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:35.010160 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 227/465] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:35.015604 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05542f24-eb71-4423-ba3a-66876440193f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:35.015887 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05542f24-eb71-4423-ba3a-66876440193f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:35.016157 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05542f24-eb71-4423-ba3a-66876440193f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:35.036765 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-05542f24-eb71-4423-ba3a-66876440193f None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:35.037949 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-05542f24-eb71-4423-ba3a-66876440193f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:35.109610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:35.120096 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 239/466] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:35.500341 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5e3ac-86cd-447f-93e5-3e65cee336ae None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:35.612165 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5e3ac-86cd-447f-93e5-3e65cee336ae None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:35.635144 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:35.652888 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c7a48-b0f9-44fa-9496-d6e485b51a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:35.653753 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c7a48-b0f9-44fa-9496-d6e485b51a55 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:35.654169 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c7a48-b0f9-44fa-9496-d6e485b51a55 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:35.654578 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c7a48-b0f9-44fa-9496-d6e485b51a55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:35.667350 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c7a48-b0f9-44fa-9496-d6e485b51a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-c88c7a48-b0f9-44fa-9496-d6e485b51a55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:35.672812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:35.673880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:35.674847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:35.674847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:35.674847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:35.674847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:35.674847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:35.674847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:35.674847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:35.674847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:35.674847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:35.674847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:35.674847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:31:35.674847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:35.677177 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 228/467] 10.222.0.40 () {56 vars in 1096 bytes} [Sat Oct 29 20:31:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:35.685174 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05542f24-eb71-4423-ba3a-66876440193f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:35.792711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05542f24-eb71-4423-ba3a-66876440193f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:35.830106 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d337ebb-a832-4f2a-af1d-9eb0706533ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:35.830720 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d337ebb-a832-4f2a-af1d-9eb0706533ef None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:35.831047 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d337ebb-a832-4f2a-af1d-9eb0706533ef None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:35.831350 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d337ebb-a832-4f2a-af1d-9eb0706533ef None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:35.832021 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d337ebb-a832-4f2a-af1d-9eb0706533ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:35.832322 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d337ebb-a832-4f2a-af1d-9eb0706533ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:35.833715 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d337ebb-a832-4f2a-af1d-9eb0706533ef None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:35.842983 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 240/468] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:31:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:35.849451 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c7a48-b0f9-44fa-9496-d6e485b51a55 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:35.956952 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c7a48-b0f9-44fa-9496-d6e485b51a55 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:35.992339 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e05619-a7c8-47dc-adcd-0f85d9fa5555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:35.993024 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e05619-a7c8-47dc-adcd-0f85d9fa5555 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:35.993350 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e05619-a7c8-47dc-adcd-0f85d9fa5555 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:35.993624 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e05619-a7c8-47dc-adcd-0f85d9fa5555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:36.005257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e05619-a7c8-47dc-adcd-0f85d9fa5555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:36.006717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e05619-a7c8-47dc-adcd-0f85d9fa5555 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-47e05619-a7c8-47dc-adcd-0f85d9fa5555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:36.021825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:36.022692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:36.023527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:36.023527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:36.023527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:36.023527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 229/469] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:36.032861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d337ebb-a832-4f2a-af1d-9eb0706533ef None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:36.098915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:36.145307 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d337ebb-a832-4f2a-af1d-9eb0706533ef None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:36.180230 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3534777-f345-461f-ad17-2b4e6c131bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:36.180839 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534777-f345-461f-ad17-2b4e6c131bbc None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:36.181116 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534777-f345-461f-ad17-2b4e6c131bbc None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:36.181385 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534777-f345-461f-ad17-2b4e6c131bbc None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:36.182079 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3534777-f345-461f-ad17-2b4e6c131bbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:36.182381 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3534777-f345-461f-ad17-2b4e6c131bbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:36.183862 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3534777-f345-461f-ad17-2b4e6c131bbc None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:36.199639 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 241/470] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:36.206407 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e05619-a7c8-47dc-adcd-0f85d9fa5555 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:36.239730 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:36.324807 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e05619-a7c8-47dc-adcd-0f85d9fa5555 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:36.362427 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7afe5-884c-4960-b5bd-6d95550e2410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:36.363391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7afe5-884c-4960-b5bd-6d95550e2410 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:36.363823 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7afe5-884c-4960-b5bd-6d95550e2410 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:36.364227 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7afe5-884c-4960-b5bd-6d95550e2410 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:36.372045 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7afe5-884c-4960-b5bd-6d95550e2410 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:36.373658 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7afe5-884c-4960-b5bd-6d95550e2410 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-97f7afe5-884c-4960-b5bd-6d95550e2410 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:31:36.385806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:36.386892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:36.387997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:36.387997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:36.387997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:31:36.387997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:31:36.387997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:31:36.387997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:31:36.387997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:31:36.387997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:31:36.387997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 29 20:31:36.387997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:36.390033 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 230/471] 10.222.0.40 () {56 vars in 1093 bytes} [Sat Oct 29 20:31:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:36.396696 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3534777-f345-461f-ad17-2b4e6c131bbc None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:36.508994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3534777-f345-461f-ad17-2b4e6c131bbc None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:36.527886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:36.546208 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1738ef-b04d-48dc-93fa-9d164f3f6e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:36.547070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1738ef-b04d-48dc-93fa-9d164f3f6e3e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:36.547371 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1738ef-b04d-48dc-93fa-9d164f3f6e3e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:36.548342 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1738ef-b04d-48dc-93fa-9d164f3f6e3e None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:36.549015 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1738ef-b04d-48dc-93fa-9d164f3f6e3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:36.549299 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1738ef-b04d-48dc-93fa-9d164f3f6e3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:36.550805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1738ef-b04d-48dc-93fa-9d164f3f6e3e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:36.571982 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 242/472] 10.222.0.40 () {56 vars in 1133 bytes} [Sat Oct 29 20:31:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:36.577426 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7afe5-884c-4960-b5bd-6d95550e2410 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:36.678632 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:36.690331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7afe5-884c-4960-b5bd-6d95550e2410 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:36.725631 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae435f4e-a0e2-4d52-9077-a31fc928167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:36.726285 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435f4e-a0e2-4d52-9077-a31fc928167d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:36.726561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435f4e-a0e2-4d52-9077-a31fc928167d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:36.726829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435f4e-a0e2-4d52-9077-a31fc928167d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:36.739717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae435f4e-a0e2-4d52-9077-a31fc928167d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:36.741207 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae435f4e-a0e2-4d52-9077-a31fc928167d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-ae435f4e-a0e2-4d52-9077-a31fc928167d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:36.758469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:36.759533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:36.760406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:36.760406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:36.760406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:36.760406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 231/473] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:36.768627 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1738ef-b04d-48dc-93fa-9d164f3f6e3e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:36.861252 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d56fc-d9b4-4387-85e5-83c7fac5f679 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:36.861591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d56fc-d9b4-4387-85e5-83c7fac5f679 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:36.861796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d56fc-d9b4-4387-85e5-83c7fac5f679 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:36.863249 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 232/474] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:31:36.869448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d087eab-2e4a-493f-8b07-f9965cdd8294 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:36.869731 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d087eab-2e4a-493f-8b07-f9965cdd8294 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:36.870001 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d087eab-2e4a-493f-8b07-f9965cdd8294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:36.881200 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1738ef-b04d-48dc-93fa-9d164f3f6e3e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:36.889397 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-4d087eab-2e4a-493f-8b07-f9965cdd8294 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:36.890581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4d087eab-2e4a-493f-8b07-f9965cdd8294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:36.927422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1320c2-0597-4bc2-bdee-7e009d9aeeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:36.929120 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1320c2-0597-4bc2-bdee-7e009d9aeeb6 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:36.930013 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1320c2-0597-4bc2-bdee-7e009d9aeeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:36.930497 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1320c2-0597-4bc2-bdee-7e009d9aeeb6 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:36.931556 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1320c2-0597-4bc2-bdee-7e009d9aeeb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:36.932339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1320c2-0597-4bc2-bdee-7e009d9aeeb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:36.934423 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1320c2-0597-4bc2-bdee-7e009d9aeeb6 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:36.953287 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 243/475] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:36.955076 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1320c2-0597-4bc2-bdee-7e009d9aeeb6 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:36.980194 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 233/476] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:31:36.995257 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:37.050560 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddd712-e0b1-4b09-84b4-36d97f850bfa None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:37.051202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddd712-e0b1-4b09-84b4-36d97f850bfa None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:37.051700 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddd712-e0b1-4b09-84b4-36d97f850bfa None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:37.053456 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 234/477] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:37.058674 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce66fa-8b63-444b-9250-44680f551cb9 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:37.059184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce66fa-8b63-444b-9250-44680f551cb9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:37.059689 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce66fa-8b63-444b-9250-44680f551cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:37.069814 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1320c2-0597-4bc2-bdee-7e009d9aeeb6 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:37.079430 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-6cce66fa-8b63-444b-9250-44680f551cb9 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:37.080959 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6cce66fa-8b63-444b-9250-44680f551cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:37.108315 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ab1b3-2d09-4560-89a9-1597366faa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:37.109036 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab1b3-2d09-4560-89a9-1597366faa2f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:37.109315 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab1b3-2d09-4560-89a9-1597366faa2f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:37.109582 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab1b3-2d09-4560-89a9-1597366faa2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:37.120442 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ab1b3-2d09-4560-89a9-1597366faa2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:37.122044 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ab1b3-2d09-4560-89a9-1597366faa2f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-7b9ab1b3-2d09-4560-89a9-1597366faa2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:31:37.140090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:37.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:37.147525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:31:37.147525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:31:37.147525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:31:37.147525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:31:37.147525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:31:37.147525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:31:37.147525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:37.147525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:37.147525 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 244/478] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:37.149655 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ab1b3-2d09-4560-89a9-1597366faa2f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:37.179447 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 235/479] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:31:37.194710 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291c9cd-36e7-4431-a280-986fe28c31aa None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:37.194993 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291c9cd-36e7-4431-a280-986fe28c31aa None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:37.195270 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291c9cd-36e7-4431-a280-986fe28c31aa None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:37.200506 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 236/480] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:31:37.201593 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ee63c-7deb-41f6-96b3-52004e5ee645 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:37.201875 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ee63c-7deb-41f6-96b3-52004e5ee645 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:37.202149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ee63c-7deb-41f6-96b3-52004e5ee645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:37.215650 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:37.221268 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-453ee63c-7deb-41f6-96b3-52004e5ee645 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:37.222520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-453ee63c-7deb-41f6-96b3-52004e5ee645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:37.266689 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:37.274715 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ab1b3-2d09-4560-89a9-1597366faa2f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:37.305484 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 237/481] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:37.312531 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ee63c-7deb-41f6-96b3-52004e5ee645 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:37.320269 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1a937-7966-4b00-887a-06fd098ac655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:37.320871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1a937-7966-4b00-887a-06fd098ac655 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:37.321147 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1a937-7966-4b00-887a-06fd098ac655 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:37.321414 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1a937-7966-4b00-887a-06fd098ac655 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:37.322097 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1a937-7966-4b00-887a-06fd098ac655 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:37.322911 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1a937-7966-4b00-887a-06fd098ac655 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:37.325675 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1a937-7966-4b00-887a-06fd098ac655 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:37.343639 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 245/482] 10.222.0.40 () {56 vars in 1148 bytes} [Sat Oct 29 20:31:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:37.349060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1a937-7966-4b00-887a-06fd098ac655 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:37.442490 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ee63c-7deb-41f6-96b3-52004e5ee645 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:37.465936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1a937-7966-4b00-887a-06fd098ac655 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:37.486130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056df9d-af6c-4a46-9327-8b00e39e1c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:37.486758 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056df9d-af6c-4a46-9327-8b00e39e1c66 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:37.487029 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056df9d-af6c-4a46-9327-8b00e39e1c66 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:37.487294 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056df9d-af6c-4a46-9327-8b00e39e1c66 None admin] PATH_INFO: `/v3/services/image` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:37.487897 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056df9d-af6c-4a46-9327-8b00e39e1c66 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:37.489255 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056df9d-af6c-4a46-9327-8b00e39e1c66 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:37.491496 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-2056df9d-af6c-4a46-9327-8b00e39e1c66 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:37.503096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:37.504312 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:37.506161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 238/483] 10.222.0.40 () {56 vars in 1105 bytes} [Sat Oct 29 20:31:37 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:37.510721 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056df9d-af6c-4a46-9327-8b00e39e1c66 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:37.514739 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7345a-ec03-4f89-9891-62c87537d1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:37.515639 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7345a-ec03-4f89-9891-62c87537d1a7 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:37.515922 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7345a-ec03-4f89-9891-62c87537d1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:37.516218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7345a-ec03-4f89-9891-62c87537d1a7 None admin] PATH_INFO: `/v3/projects/38c8029f1fc24cd098d360f54c51451d/users/b61b58116d364480aed22b5715f6a78a/roles/9b15e747c88749bfb25139f3bd80b395` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:37.519349 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7345a-ec03-4f89-9891-62c87537d1a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=38c8029f1fc24cd098d360f54c51451d, user_id=b61b58116d364480aed22b5715f6a78a, role_id=9b15e747c88749bfb25139f3bd80b395)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:37.520779 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7345a-ec03-4f89-9891-62c87537d1a7 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:37.539382 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 246/484] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:31:37 2022] PUT /identity/v3/projects/38c8029f1fc24cd098d360f54c51451d/users/b61b58116d364480aed22b5715f6a78a/roles/9b15e747c88749bfb25139f3bd80b395 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 20:31:37.539382 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7345a-ec03-4f89-9891-62c87537d1a7 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:37.570332 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:37.660676 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056df9d-af6c-4a46-9327-8b00e39e1c66 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:37.691019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7345a-ec03-4f89-9891-62c87537d1a7 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:37.698932 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3f179-a52f-46df-864d-f633f3a239ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:37.699599 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3f179-a52f-46df-864d-f633f3a239ba None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:37.699938 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3f179-a52f-46df-864d-f633f3a239ba None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:37.700220 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3f179-a52f-46df-864d-f633f3a239ba None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:37.700871 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3f179-a52f-46df-864d-f633f3a239ba None admin] RBAC: Adding query filter params (name=image) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:37.701173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3f179-a52f-46df-864d-f633f3a239ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:37.702600 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3f179-a52f-46df-864d-f633f3a239ba None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:37.707853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 239/485] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:37.713074 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3f179-a52f-46df-864d-f633f3a239ba None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:37.732435 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192f020-c1ee-4dca-afed-124c7889c403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:37.733098 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192f020-c1ee-4dca-afed-124c7889c403 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:37.733365 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192f020-c1ee-4dca-afed-124c7889c403 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:37.733632 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192f020-c1ee-4dca-afed-124c7889c403 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:37.734233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192f020-c1ee-4dca-afed-124c7889c403 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:37.736503 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192f020-c1ee-4dca-afed-124c7889c403 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-c192f020-c1ee-4dca-afed-124c7889c403 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:37.747935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:37.748924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:37.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 247/486] 10.222.0.40 () {56 vars in 1129 bytes} [Sat Oct 29 20:31:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:37.753134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192f020-c1ee-4dca-afed-124c7889c403 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:37.791099 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:37.836405 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3f179-a52f-46df-864d-f633f3a239ba None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:37.844233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:37.865284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192f020-c1ee-4dca-afed-124c7889c403 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:37.882971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce22fe-11f1-4284-afd9-13693e228e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:37.883726 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce22fe-11f1-4284-afd9-13693e228e55 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:37.884070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce22fe-11f1-4284-afd9-13693e228e55 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:37.884410 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce22fe-11f1-4284-afd9-13693e228e55 None admin] PATH_INFO: `/v3/services/network` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:37.885065 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce22fe-11f1-4284-afd9-13693e228e55 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:37.886484 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce22fe-11f1-4284-afd9-13693e228e55 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-23ce22fe-11f1-4284-afd9-13693e228e55 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:37.895705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:37.896926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:37.897714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 240/487] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:37 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:37.898451 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce22fe-11f1-4284-afd9-13693e228e55 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:37.905802 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8ed35-d8ce-42ac-adb9-e45c7b6fdc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:37.906417 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8ed35-d8ce-42ac-adb9-e45c7b6fdc9a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:37.906694 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8ed35-d8ce-42ac-adb9-e45c7b6fdc9a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:37.907003 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8ed35-d8ce-42ac-adb9-e45c7b6fdc9a None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:37.907794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8ed35-d8ce-42ac-adb9-e45c7b6fdc9a None admin] RBAC: Adding query filter params (type=image) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:37.908099 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8ed35-d8ce-42ac-adb9-e45c7b6fdc9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:37.909496 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8ed35-d8ce-42ac-adb9-e45c7b6fdc9a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:37.915235 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 248/488] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:37.916062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8ed35-d8ce-42ac-adb9-e45c7b6fdc9a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:38.021979 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce22fe-11f1-4284-afd9-13693e228e55 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:38.048051 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8ed35-d8ce-42ac-adb9-e45c7b6fdc9a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:38.051202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:38.060459 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145a3d2-165c-4e1d-9873-bf5cce3df3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:38.061076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a3d2-165c-4e1d-9873-bf5cce3df3e1 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:38.061354 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a3d2-165c-4e1d-9873-bf5cce3df3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:38.061617 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a3d2-165c-4e1d-9873-bf5cce3df3e1 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:38.062265 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145a3d2-165c-4e1d-9873-bf5cce3df3e1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:38.062561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145a3d2-165c-4e1d-9873-bf5cce3df3e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:38.064490 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145a3d2-165c-4e1d-9873-bf5cce3df3e1 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:38.069437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 241/489] 10.222.0.40 () {56 vars in 1124 bytes} [Sat Oct 29 20:31:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:38.075162 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145a3d2-165c-4e1d-9873-bf5cce3df3e1 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:38.096689 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70e0f6-6684-4690-bca5-0db7312ab9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:38.098071 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70e0f6-6684-4690-bca5-0db7312ab9c2 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:38.098550 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70e0f6-6684-4690-bca5-0db7312ab9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:38.099026 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70e0f6-6684-4690-bca5-0db7312ab9c2 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:38.099928 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70e0f6-6684-4690-bca5-0db7312ab9c2 None admin] RBAC: Adding query filter params (name=network) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:38.101124 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70e0f6-6684-4690-bca5-0db7312ab9c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:38.103495 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70e0f6-6684-4690-bca5-0db7312ab9c2 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:38.111825 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 249/490] 10.222.0.40 () {56 vars in 1112 bytes} [Sat Oct 29 20:31:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:38.117899 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70e0f6-6684-4690-bca5-0db7312ab9c2 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:38.130338 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:38.205492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145a3d2-165c-4e1d-9873-bf5cce3df3e1 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:38.231608 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70e0f6-6684-4690-bca5-0db7312ab9c2 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:38.246525 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299f316-146a-42cc-9bec-ea50eaab6fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:38.247202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299f316-146a-42cc-9bec-ea50eaab6fad None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:38.247525 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299f316-146a-42cc-9bec-ea50eaab6fad None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:38.247799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299f316-146a-42cc-9bec-ea50eaab6fad None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:38.248439 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299f316-146a-42cc-9bec-ea50eaab6fad None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:38.248739 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299f316-146a-42cc-9bec-ea50eaab6fad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:38.250210 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299f316-146a-42cc-9bec-ea50eaab6fad None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:38.258759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 242/491] 10.222.0.40 () {56 vars in 1124 bytes} [Sat Oct 29 20:31:38 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:38.280544 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e574a2-b73f-4212-a88d-7d1a4fb9cedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:38.281633 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e574a2-b73f-4212-a88d-7d1a4fb9cedf None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:38.282664 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e574a2-b73f-4212-a88d-7d1a4fb9cedf None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:38.283521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e574a2-b73f-4212-a88d-7d1a4fb9cedf None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:38.284468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e574a2-b73f-4212-a88d-7d1a4fb9cedf None admin] RBAC: Adding query filter params (type=network) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:38.285053 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e574a2-b73f-4212-a88d-7d1a4fb9cedf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:38.286751 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e574a2-b73f-4212-a88d-7d1a4fb9cedf None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:38.292570 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 250/492] 10.222.0.40 () {56 vars in 1112 bytes} [Sat Oct 29 20:31:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:40.036084 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd240191-9161-464b-acf8-ded011d7da74 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:40.036620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd240191-9161-464b-acf8-ded011d7da74 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:40.036620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd240191-9161-464b-acf8-ded011d7da74 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:40.038200 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 243/493] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:40.043462 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778710ca-62d9-47e9-b82d-f679b38be074 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:40.043868 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778710ca-62d9-47e9-b82d-f679b38be074 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:40.044019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778710ca-62d9-47e9-b82d-f679b38be074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:40.063591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-778710ca-62d9-47e9-b82d-f679b38be074 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:40.064788 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-778710ca-62d9-47e9-b82d-f679b38be074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:40.136418 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 251/494] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:31:40.475925 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd240191-9161-464b-acf8-ded011d7da74 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:40.483397 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f64cf-082e-47ca-9f34-e9c0ea480232 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:40.483975 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f64cf-082e-47ca-9f34-e9c0ea480232 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:40.484455 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f64cf-082e-47ca-9f34-e9c0ea480232 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:40.486691 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 252/495] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:31:40.492294 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59dc4d-86a5-4654-92f3-8103604f993b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:40.492935 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59dc4d-86a5-4654-92f3-8103604f993b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:40.493601 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59dc4d-86a5-4654-92f3-8103604f993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:40.501548 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:40.523331 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6f59dc4d-86a5-4654-92f3-8103604f993b None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:40.523331 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6f59dc4d-86a5-4654-92f3-8103604f993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:40.537507 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:40.585917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd240191-9161-464b-acf8-ded011d7da74 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:40.593732 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 253/496] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:31:40.623542 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4def7b-bb9c-4070-aca2-1e5d2a1c37c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:40.624172 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4def7b-bb9c-4070-aca2-1e5d2a1c37c4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:40.624455 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4def7b-bb9c-4070-aca2-1e5d2a1c37c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:40.624726 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4def7b-bb9c-4070-aca2-1e5d2a1c37c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:40.638713 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4def7b-bb9c-4070-aca2-1e5d2a1c37c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-2a4def7b-bb9c-4070-aca2-1e5d2a1c37c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:31:40.643652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:40.644754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:40.645717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:40.645717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:40.645717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:40.645717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:40.645717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:31:40.645717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:31:40.645717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:31:40.645717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:31:40.645717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:31:40.645717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:31:40.645717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:31:40.645717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:40.645717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 244/497] 10.222.0.40 () {56 vars in 1096 bytes} [Sat Oct 29 20:31:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:40.652587 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59dc4d-86a5-4654-92f3-8103604f993b None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:40.757072 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59dc4d-86a5-4654-92f3-8103604f993b None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:40.776175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e78d9-ba07-4e79-ac56-052b813faa61 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:40.776481 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e78d9-ba07-4e79-ac56-052b813faa61 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:40.776738 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e78d9-ba07-4e79-ac56-052b813faa61 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:40.778059 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 245/498] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:31:40.783267 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397f98e-dbdc-4d6a-bbfd-cec93246e0c8 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:40.783646 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397f98e-dbdc-4d6a-bbfd-cec93246e0c8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:40.783936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397f98e-dbdc-4d6a-bbfd-cec93246e0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:40.792366 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:40.798161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747671c1-517a-45c8-a72a-856ae3d53dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:40.799178 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747671c1-517a-45c8-a72a-856ae3d53dd0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:40.799477 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747671c1-517a-45c8-a72a-856ae3d53dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:40.800102 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747671c1-517a-45c8-a72a-856ae3d53dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:40.801154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747671c1-517a-45c8-a72a-856ae3d53dd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:40.801478 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747671c1-517a-45c8-a72a-856ae3d53dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:40.802850 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747671c1-517a-45c8-a72a-856ae3d53dd0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:40.804673 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-4397f98e-dbdc-4d6a-bbfd-cec93246e0c8 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:40.805941 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4397f98e-dbdc-4d6a-bbfd-cec93246e0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:40.815946 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 254/499] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:31:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:40.815946 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d29e5d-559b-4725-a879-3531ea58b13e None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:40.815946 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d29e5d-559b-4725-a879-3531ea58b13e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:40.815946 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d29e5d-559b-4725-a879-3531ea58b13e None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:40.815946 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 255/500] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:40.818072 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d29e5d-559b-4725-a879-3531ea58b13e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:40.879286 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 246/501] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 20:31:40.880753 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babfd46-a53b-43d7-bdae-5729648c3f93 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:40.881034 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babfd46-a53b-43d7-bdae-5729648c3f93 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:40.881305 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babfd46-a53b-43d7-bdae-5729648c3f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:40.904474 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-5babfd46-a53b-43d7-bdae-5729648c3f93 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:40.905762 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5babfd46-a53b-43d7-bdae-5729648c3f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:40.953118 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d29e5d-559b-4725-a879-3531ea58b13e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:40.956345 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:40.985361 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 247/502] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 20:31:40.995778 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babfd46-a53b-43d7-bdae-5729648c3f93 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:41.001067 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bba28-ee44-469b-97a8-9d59d3c3ec6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:41.001779 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bba28-ee44-469b-97a8-9d59d3c3ec6e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:41.002129 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bba28-ee44-469b-97a8-9d59d3c3ec6e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:41.002533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bba28-ee44-469b-97a8-9d59d3c3ec6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:41.014409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bba28-ee44-469b-97a8-9d59d3c3ec6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:41.016622 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bba28-ee44-469b-97a8-9d59d3c3ec6e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-a10bba28-ee44-469b-97a8-9d59d3c3ec6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:41.032161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:41.033756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:41.034760 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:41.034760 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:41.034760 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:41.038355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 256/503] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:41.039417 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bba28-ee44-469b-97a8-9d59d3c3ec6e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:41.090588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:41.103869 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babfd46-a53b-43d7-bdae-5729648c3f93 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:41.143891 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2bc97-2e84-494f-b89a-1756dfad60c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:41.144496 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2bc97-2e84-494f-b89a-1756dfad60c4 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:41.144770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2bc97-2e84-494f-b89a-1756dfad60c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:41.145036 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2bc97-2e84-494f-b89a-1756dfad60c4 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:41.145675 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2bc97-2e84-494f-b89a-1756dfad60c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:41.147048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2bc97-2e84-494f-b89a-1756dfad60c4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:41.163530 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bba28-ee44-469b-97a8-9d59d3c3ec6e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:41.166524 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 248/504] 10.222.0.40 () {60 vars in 1141 bytes} [Sat Oct 29 20:31:40 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:31:41.206794 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2bc97-2e84-494f-b89a-1756dfad60c4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:41.210410 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546d00f-9805-48a4-9938-bd4e2a7db5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:41.211027 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546d00f-9805-48a4-9938-bd4e2a7db5ee None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:41.211336 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546d00f-9805-48a4-9938-bd4e2a7db5ee None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:41.211678 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546d00f-9805-48a4-9938-bd4e2a7db5ee None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:41.212385 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546d00f-9805-48a4-9938-bd4e2a7db5ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:41.212692 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546d00f-9805-48a4-9938-bd4e2a7db5ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:41.215668 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546d00f-9805-48a4-9938-bd4e2a7db5ee None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:41.237772 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 257/505] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:41.239719 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546d00f-9805-48a4-9938-bd4e2a7db5ee None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:41.262991 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:41.356842 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2bc97-2e84-494f-b89a-1756dfad60c4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:41.373026 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546d00f-9805-48a4-9938-bd4e2a7db5ee None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:41.374843 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:41.400756 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a4971-16f4-4195-80e5-29ecf0fce9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:41.402054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a4971-16f4-4195-80e5-29ecf0fce9f1 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:41.402054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a4971-16f4-4195-80e5-29ecf0fce9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:41.402054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a4971-16f4-4195-80e5-29ecf0fce9f1 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:41.402550 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a4971-16f4-4195-80e5-29ecf0fce9f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:41.404755 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a4971-16f4-4195-80e5-29ecf0fce9f1 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:41.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8408a-d923-4d49-9ab2-8f351923f466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:41.416351 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8408a-d923-4d49-9ab2-8f351923f466 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:41.416351 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8408a-d923-4d49-9ab2-8f351923f466 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:41.416351 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8408a-d923-4d49-9ab2-8f351923f466 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:41.420944 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 249/506] 10.222.0.40 () {60 vars in 1141 bytes} [Sat Oct 29 20:31:41 2022] POST /identity/v3/services => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 20:31:41.423234 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a4971-16f4-4195-80e5-29ecf0fce9f1 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:41.424344 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8408a-d923-4d49-9ab2-8f351923f466 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:41.425823 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8408a-d923-4d49-9ab2-8f351923f466 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-3dd8408a-d923-4d49-9ab2-8f351923f466 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:31:41.441898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:41.442994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:41.445284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:41.445284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:41.445284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:31:41.445284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:31:41.445284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:31:41.445284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:31:41.445284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:31:41.445284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:31:41.445284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 29 20:31:41.445284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:41.445284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 258/507] 10.222.0.40 () {56 vars in 1093 bytes} [Sat Oct 29 20:31:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:41.456405 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8408a-d923-4d49-9ab2-8f351923f466 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:41.543265 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:41.567750 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a4971-16f4-4195-80e5-29ecf0fce9f1 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:41.604848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8408a-d923-4d49-9ab2-8f351923f466 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:41.614054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8f74d-ab80-47b1-a109-67dbf82b4a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:41.614927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8f74d-ab80-47b1-a109-67dbf82b4a0e None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:41.615466 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8f74d-ab80-47b1-a109-67dbf82b4a0e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:41.615908 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8f74d-ab80-47b1-a109-67dbf82b4a0e None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:41.616847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8f74d-ab80-47b1-a109-67dbf82b4a0e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:41.618512 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8f74d-ab80-47b1-a109-67dbf82b4a0e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:41.644442 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 250/508] 10.222.0.40 () {60 vars in 1141 bytes} [Sat Oct 29 20:31:41 2022] POST /identity/v3/services => generated 240 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:31:41.676044 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adfef6-b4a3-40c3-a62a-4f6e2a5e3b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:41.676680 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adfef6-b4a3-40c3-a62a-4f6e2a5e3b26 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:41.676961 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adfef6-b4a3-40c3-a62a-4f6e2a5e3b26 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:41.677233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adfef6-b4a3-40c3-a62a-4f6e2a5e3b26 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:41.677984 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adfef6-b4a3-40c3-a62a-4f6e2a5e3b26 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:41.678290 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adfef6-b4a3-40c3-a62a-4f6e2a5e3b26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:41.679906 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adfef6-b4a3-40c3-a62a-4f6e2a5e3b26 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:41.701574 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 259/509] 10.222.0.40 () {56 vars in 1133 bytes} [Sat Oct 29 20:31:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:41.707517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8f74d-ab80-47b1-a109-67dbf82b4a0e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:41.836127 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8f74d-ab80-47b1-a109-67dbf82b4a0e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:41.875880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86704694-0676-4127-9213-81928315e7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:41.876557 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86704694-0676-4127-9213-81928315e7aa None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:41.876831 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86704694-0676-4127-9213-81928315e7aa None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:41.877096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86704694-0676-4127-9213-81928315e7aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:41.900590 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:41.952270 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86704694-0676-4127-9213-81928315e7aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:41.953816 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86704694-0676-4127-9213-81928315e7aa None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:42.058084 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 251/510] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:31:41 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 29 20:31:42.064121 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adfef6-b4a3-40c3-a62a-4f6e2a5e3b26 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:42.082569 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:42.168855 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adfef6-b4a3-40c3-a62a-4f6e2a5e3b26 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:42.206429 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6f49a-07d8-4501-94e0-38d5dde2ac28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:42.207119 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6f49a-07d8-4501-94e0-38d5dde2ac28 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:42.207434 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6f49a-07d8-4501-94e0-38d5dde2ac28 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:42.207754 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6f49a-07d8-4501-94e0-38d5dde2ac28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:42.218362 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6f49a-07d8-4501-94e0-38d5dde2ac28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:42.220745 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6f49a-07d8-4501-94e0-38d5dde2ac28 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-e9e6f49a-07d8-4501-94e0-38d5dde2ac28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:42.240717 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:42.241685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:42.243073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:42.243073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:42.243073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:42.243073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 260/511] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:42.251545 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86704694-0676-4127-9213-81928315e7aa None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:42.305363 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:42.358789 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86704694-0676-4127-9213-81928315e7aa None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:42.395279 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d62f3-bd78-48d5-ac9f-8866844ee00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:42.395933 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d62f3-bd78-48d5-ac9f-8866844ee00e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:42.396212 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d62f3-bd78-48d5-ac9f-8866844ee00e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:42.396486 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d62f3-bd78-48d5-ac9f-8866844ee00e None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:42.397149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d62f3-bd78-48d5-ac9f-8866844ee00e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:42.397452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d62f3-bd78-48d5-ac9f-8866844ee00e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:42.398951 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d62f3-bd78-48d5-ac9f-8866844ee00e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:42.413381 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 252/512] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:42.418790 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6f49a-07d8-4501-94e0-38d5dde2ac28 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:42.500309 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:42.541170 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6f49a-07d8-4501-94e0-38d5dde2ac28 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:42.577209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc545780-8cb2-4e8d-88ea-86cf846595d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:42.577837 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc545780-8cb2-4e8d-88ea-86cf846595d9 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:42.578221 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc545780-8cb2-4e8d-88ea-86cf846595d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:42.578999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc545780-8cb2-4e8d-88ea-86cf846595d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:42.586563 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc545780-8cb2-4e8d-88ea-86cf846595d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:42.588030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc545780-8cb2-4e8d-88ea-86cf846595d9 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-cc545780-8cb2-4e8d-88ea-86cf846595d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:31:42.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:42.601191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:42.602055 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:31:42.602055 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:31:42.602055 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:31:42.602055 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:31:42.602055 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:31:42.602055 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:31:42.602055 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:31:42.602055 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:42.602055 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 261/513] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:42.608802 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d62f3-bd78-48d5-ac9f-8866844ee00e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:42.721421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d62f3-bd78-48d5-ac9f-8866844ee00e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:42.732502 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:42.758732 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f308a31-f1b8-44e1-a3b1-c86808ee1ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:42.759265 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f308a31-f1b8-44e1-a3b1-c86808ee1ed5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:42.759575 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f308a31-f1b8-44e1-a3b1-c86808ee1ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:42.759849 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f308a31-f1b8-44e1-a3b1-c86808ee1ed5 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:42.760541 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f308a31-f1b8-44e1-a3b1-c86808ee1ed5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:42.760845 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f308a31-f1b8-44e1-a3b1-c86808ee1ed5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:42.762266 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f308a31-f1b8-44e1-a3b1-c86808ee1ed5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:42.775246 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 253/514] 10.222.0.40 () {56 vars in 1148 bytes} [Sat Oct 29 20:31:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:42.781175 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc545780-8cb2-4e8d-88ea-86cf846595d9 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:42.888107 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc545780-8cb2-4e8d-88ea-86cf846595d9 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:42.919677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:42.932932 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3e118-a2dd-49fd-958f-54780df84620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:42.933602 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3e118-a2dd-49fd-958f-54780df84620 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:42.933879 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3e118-a2dd-49fd-958f-54780df84620 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:42.934147 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3e118-a2dd-49fd-958f-54780df84620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:42.934875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3e118-a2dd-49fd-958f-54780df84620 None admin] RBAC: Adding query filter params (role.id=9b15e747c88749bfb25139f3bd80b395, scope.project.id=38c8029f1fc24cd098d360f54c51451d, user.id=b61b58116d364480aed22b5715f6a78a) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:42.935178 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3e118-a2dd-49fd-958f-54780df84620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:42.936836 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3e118-a2dd-49fd-958f-54780df84620 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:42.944735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 262/515] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:31:42 2022] GET /identity/v3/role_assignments?user.id=b61b58116d364480aed22b5715f6a78a&scope.project.id=38c8029f1fc24cd098d360f54c51451d&role.id=9b15e747c88749bfb25139f3bd80b395 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:43.748105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313164b3-0bc4-4e57-80e1-7d5338cd1a5a None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:43.748658 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313164b3-0bc4-4e57-80e1-7d5338cd1a5a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:43.748658 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313164b3-0bc4-4e57-80e1-7d5338cd1a5a None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:43.750221 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 254/516] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:43.756638 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103f0c-429d-4e46-89c6-06d7574deb47 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:43.757105 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103f0c-429d-4e46-89c6-06d7574deb47 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:43.757181 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103f0c-429d-4e46-89c6-06d7574deb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:43.778489 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-bc103f0c-429d-4e46-89c6-06d7574deb47 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:43.779746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bc103f0c-429d-4e46-89c6-06d7574deb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:43.862657 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 263/517] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:43 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:31:44.101901 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c18d7f-83a6-4be5-bdfc-49a4832ed225 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:44.102306 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c18d7f-83a6-4be5-bdfc-49a4832ed225 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:44.102685 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c18d7f-83a6-4be5-bdfc-49a4832ed225 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:44.104431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 255/518] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:44.109691 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f95452-0e31-49ce-af1f-d75f257587d6 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:44.111487 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f95452-0e31-49ce-af1f-d75f257587d6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:44.111864 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f95452-0e31-49ce-af1f-d75f257587d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:44.132585 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f7f95452-0e31-49ce-af1f-d75f257587d6 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:44.133928 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f7f95452-0e31-49ce-af1f-d75f257587d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:44.199450 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c18d7f-83a6-4be5-bdfc-49a4832ed225 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:44.211245 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 264/519] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:44 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:31:44.212903 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289985d2-1bfa-4795-96ab-3d6684594140 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:44.213398 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289985d2-1bfa-4795-96ab-3d6684594140 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:44.213896 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289985d2-1bfa-4795-96ab-3d6684594140 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:44.215335 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 265/520] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:44.222611 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3093f-4b8a-4478-b798-6fafe4eb64b9 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:44.222889 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3093f-4b8a-4478-b798-6fafe4eb64b9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:44.223162 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3093f-4b8a-4478-b798-6fafe4eb64b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:44.245835 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-98f3093f-4b8a-4478-b798-6fafe4eb64b9 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:44.247434 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-98f3093f-4b8a-4478-b798-6fafe4eb64b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:44.305533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:44.323570 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c18d7f-83a6-4be5-bdfc-49a4832ed225 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:44.338502 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 266/521] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:44 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:31:44.368295 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8a48-2615-4984-bb9c-499224f601f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:44.369237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8a48-2615-4984-bb9c-499224f601f7 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:44.369707 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8a48-2615-4984-bb9c-499224f601f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:44.370189 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8a48-2615-4984-bb9c-499224f601f7 None admin] PATH_INFO: `/v3/services/image` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:44.371010 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde8a48-2615-4984-bb9c-499224f601f7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:44.372612 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde8a48-2615-4984-bb9c-499224f601f7 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-fbde8a48-2615-4984-bb9c-499224f601f7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:44.383070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:44.384030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:44.384874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:44.384874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:44.384874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:44.384874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:44.384874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:44.384874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:44.384874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:44.384874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:44.384874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:44.384874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:44.384874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:31:44.384874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:44.384874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 20:31:44.384874 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:44.387508 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 256/522] 10.222.0.40 () {56 vars in 1105 bytes} [Sat Oct 29 20:31:44 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:44.393194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3093f-4b8a-4478-b798-6fafe4eb64b9 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:44.505777 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3093f-4b8a-4478-b798-6fafe4eb64b9 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:44.535020 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8a48-2615-4984-bb9c-499224f601f7 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:44.542596 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc151f-7487-4adf-af85-f31c36a2bbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:44.543555 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc151f-7487-4adf-af85-f31c36a2bbad None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:44.544028 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc151f-7487-4adf-af85-f31c36a2bbad None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:44.544491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc151f-7487-4adf-af85-f31c36a2bbad None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:44.545348 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc151f-7487-4adf-af85-f31c36a2bbad None admin] RBAC: Adding query filter params (name=image) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:44.545652 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc151f-7487-4adf-af85-f31c36a2bbad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:44.547868 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc151f-7487-4adf-af85-f31c36a2bbad None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:44.552942 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 267/523] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:44.558778 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc151f-7487-4adf-af85-f31c36a2bbad None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:44.579921 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:44.626373 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:44.658421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8a48-2615-4984-bb9c-499224f601f7 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:44.693135 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc151f-7487-4adf-af85-f31c36a2bbad None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:44.705481 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c9a2c-f6be-4b70-85ff-0116ba53896b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:44.706631 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c9a2c-f6be-4b70-85ff-0116ba53896b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:44.707110 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c9a2c-f6be-4b70-85ff-0116ba53896b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:44.707633 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c9a2c-f6be-4b70-85ff-0116ba53896b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:44.708454 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c9a2c-f6be-4b70-85ff-0116ba53896b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:44.709904 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c9a2c-f6be-4b70-85ff-0116ba53896b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-635c9a2c-f6be-4b70-85ff-0116ba53896b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:44.720527 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:44.721520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:44.727838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 257/524] 10.222.0.40 () {56 vars in 1129 bytes} [Sat Oct 29 20:31:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:31:44.728646 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c9a2c-f6be-4b70-85ff-0116ba53896b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:44.733689 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb532827-d9f7-4314-932a-fe2f8828c5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:44.734288 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb532827-d9f7-4314-932a-fe2f8828c5e0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:44.734906 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb532827-d9f7-4314-932a-fe2f8828c5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:44.734906 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb532827-d9f7-4314-932a-fe2f8828c5e0 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:44.735573 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb532827-d9f7-4314-932a-fe2f8828c5e0 None admin] RBAC: Adding query filter params (type=image) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:44.735871 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb532827-d9f7-4314-932a-fe2f8828c5e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:44.737230 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb532827-d9f7-4314-932a-fe2f8828c5e0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:44.742129 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 268/525] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:44.743508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb532827-d9f7-4314-932a-fe2f8828c5e0 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:44.834472 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:44.838625 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c9a2c-f6be-4b70-85ff-0116ba53896b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:44.850592 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb532827-d9f7-4314-932a-fe2f8828c5e0 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:44.864118 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:44.883447 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36359092-3877-4ad6-937c-58936570731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:44.884082 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36359092-3877-4ad6-937c-58936570731f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:44.884363 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36359092-3877-4ad6-937c-58936570731f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:44.884623 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36359092-3877-4ad6-937c-58936570731f None admin] PATH_INFO: `/v3/services/network` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:44.885194 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36359092-3877-4ad6-937c-58936570731f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:44.886548 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36359092-3877-4ad6-937c-58936570731f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:44.890214 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80726e8-e8ee-47f1-ab3b-8aff174dcdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:44.890817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80726e8-e8ee-47f1-ab3b-8aff174dcdb2 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:44.891781 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80726e8-e8ee-47f1-ab3b-8aff174dcdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:44.892161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80726e8-e8ee-47f1-ab3b-8aff174dcdb2 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:44.892792 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80726e8-e8ee-47f1-ab3b-8aff174dcdb2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:44.893093 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80726e8-e8ee-47f1-ab3b-8aff174dcdb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:44.894455 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80726e8-e8ee-47f1-ab3b-8aff174dcdb2 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-36359092-3877-4ad6-937c-58936570731f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:44.896518 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:44.897511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:44.898344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 258/526] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:44 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:44.899754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36359092-3877-4ad6-937c-58936570731f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:44.909022 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 269/527] 10.222.0.40 () {56 vars in 1124 bytes} [Sat Oct 29 20:31:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:44.909022 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80726e8-e8ee-47f1-ab3b-8aff174dcdb2 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:45.008105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36359092-3877-4ad6-937c-58936570731f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:45.013012 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80726e8-e8ee-47f1-ab3b-8aff174dcdb2 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:45.049819 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db0c6c-4da4-4bf2-bdd4-6ae004cbe2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:45.050425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db0c6c-4da4-4bf2-bdd4-6ae004cbe2e3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:45.050704 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db0c6c-4da4-4bf2-bdd4-6ae004cbe2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:45.050975 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db0c6c-4da4-4bf2-bdd4-6ae004cbe2e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:45.051818 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db0c6c-4da4-4bf2-bdd4-6ae004cbe2e3 None admin] RBAC: Adding query filter params (interface=public, service_id=694505bdb083407cb33613d1a281f1d9, region_id=RegionOne) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:45.052127 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db0c6c-4da4-4bf2-bdd4-6ae004cbe2e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:45.052697 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b425d-1b30-4782-85fc-a09e62287f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:45.053297 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b425d-1b30-4782-85fc-a09e62287f16 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:45.053539 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db0c6c-4da4-4bf2-bdd4-6ae004cbe2e3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:45.053646 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b425d-1b30-4782-85fc-a09e62287f16 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:45.053824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b425d-1b30-4782-85fc-a09e62287f16 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:45.054440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b425d-1b30-4782-85fc-a09e62287f16 None admin] RBAC: Adding query filter params (name=network) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:45.054734 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b425d-1b30-4782-85fc-a09e62287f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:45.056120 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b425d-1b30-4782-85fc-a09e62287f16 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:45.066228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 270/528] 10.222.0.40 () {56 vars in 1112 bytes} [Sat Oct 29 20:31:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:45.066228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b425d-1b30-4782-85fc-a09e62287f16 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:45.066443 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 259/529] 10.222.0.40 () {56 vars in 1251 bytes} [Sat Oct 29 20:31:44 2022] GET /identity/v3/endpoints?service_id=694505bdb083407cb33613d1a281f1d9&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:45.067237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db0c6c-4da4-4bf2-bdd4-6ae004cbe2e3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:45.099510 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:45.111091 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:45.180701 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db0c6c-4da4-4bf2-bdd4-6ae004cbe2e3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:45.183178 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b425d-1b30-4782-85fc-a09e62287f16 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:45.217345 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c6a63-8f1b-4f11-896f-97e7e0ae0130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:45.217952 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c6a63-8f1b-4f11-896f-97e7e0ae0130 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:45.218230 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c6a63-8f1b-4f11-896f-97e7e0ae0130 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:45.218500 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c6a63-8f1b-4f11-896f-97e7e0ae0130 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:45.219609 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d2763-d24d-452d-ad48-486d07bfe3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:45.219827 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c6a63-8f1b-4f11-896f-97e7e0ae0130 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:45.220051 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c6a63-8f1b-4f11-896f-97e7e0ae0130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:45.220980 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d2763-d24d-452d-ad48-486d07bfe3d3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:45.221333 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c6a63-8f1b-4f11-896f-97e7e0ae0130 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:45.221702 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d2763-d24d-452d-ad48-486d07bfe3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:45.222216 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d2763-d24d-452d-ad48-486d07bfe3d3 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:45.223192 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d2763-d24d-452d-ad48-486d07bfe3d3 None admin] RBAC: Adding query filter params (type=network) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:45.223526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d2763-d24d-452d-ad48-486d07bfe3d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:45.224871 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d2763-d24d-452d-ad48-486d07bfe3d3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:45.226121 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 271/530] 10.222.0.40 () {56 vars in 1124 bytes} [Sat Oct 29 20:31:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:45.231810 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c6a63-8f1b-4f11-896f-97e7e0ae0130 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:45.235184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 260/531] 10.222.0.40 () {56 vars in 1112 bytes} [Sat Oct 29 20:31:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:45.236585 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d2763-d24d-452d-ad48-486d07bfe3d3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:45.344096 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:45.348118 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c6a63-8f1b-4f11-896f-97e7e0ae0130 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:45.349713 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:45.356797 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d2763-d24d-452d-ad48-486d07bfe3d3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:45.387045 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74202e5c-c840-497b-a5b1-7d8b26d92ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:45.388777 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74202e5c-c840-497b-a5b1-7d8b26d92ac8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:45.389056 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74202e5c-c840-497b-a5b1-7d8b26d92ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:45.389355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74202e5c-c840-497b-a5b1-7d8b26d92ac8 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:45.389960 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74202e5c-c840-497b-a5b1-7d8b26d92ac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:45.391389 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74202e5c-c840-497b-a5b1-7d8b26d92ac8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:45.393522 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47894861-5062-4c83-bac2-c9b5d457dc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:45.394115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894861-5062-4c83-bac2-c9b5d457dc8f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:45.394417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894861-5062-4c83-bac2-c9b5d457dc8f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:45.394677 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894861-5062-4c83-bac2-c9b5d457dc8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:45.395366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47894861-5062-4c83-bac2-c9b5d457dc8f None admin] RBAC: Adding query filter params (interface=public, service_id=64b9c0f35016469fa1dd02cec35e8d61, region_id=RegionOne) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:45.395669 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47894861-5062-4c83-bac2-c9b5d457dc8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:45.407924 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47894861-5062-4c83-bac2-c9b5d457dc8f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:45.408148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 272/532] 10.222.0.40 () {56 vars in 1087 bytes} [Sat Oct 29 20:31:45 2022] GET /identity/v3/services => generated 1002 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 20:31:45.408148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74202e5c-c840-497b-a5b1-7d8b26d92ac8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:45.413872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 261/533] 10.222.0.40 () {56 vars in 1251 bytes} [Sat Oct 29 20:31:45 2022] GET /identity/v3/endpoints?service_id=64b9c0f35016469fa1dd02cec35e8d61&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:45.420528 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47894861-5062-4c83-bac2-c9b5d457dc8f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:45.522357 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74202e5c-c840-497b-a5b1-7d8b26d92ac8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:45.543271 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47894861-5062-4c83-bac2-c9b5d457dc8f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:45.561810 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532621da-4025-4535-89a6-dff00f7abf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:45.562406 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532621da-4025-4535-89a6-dff00f7abf69 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:45.562682 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532621da-4025-4535-89a6-dff00f7abf69 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:45.563501 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532621da-4025-4535-89a6-dff00f7abf69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:45.564320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532621da-4025-4535-89a6-dff00f7abf69 None admin] RBAC: Adding query filter params (interface=public, service_id=794191c1c4724f71ba42d792bec0057e, region_id=RegionOne) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:45.564628 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532621da-4025-4535-89a6-dff00f7abf69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:45.566088 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532621da-4025-4535-89a6-dff00f7abf69 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:45.579725 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 273/534] 10.222.0.40 () {56 vars in 1251 bytes} [Sat Oct 29 20:31:45 2022] GET /identity/v3/endpoints?service_id=794191c1c4724f71ba42d792bec0057e&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:45.579725 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af90060-bf35-4027-a1a5-576c5cdbddb3 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:45.579725 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af90060-bf35-4027-a1a5-576c5cdbddb3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:45.579725 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af90060-bf35-4027-a1a5-576c5cdbddb3 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:45.579725 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 274/535] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:45.583890 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af90060-bf35-4027-a1a5-576c5cdbddb3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:45.588476 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12507-f7de-45ec-b753-1dda38793bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:45.589081 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12507-f7de-45ec-b753-1dda38793bdb None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:45.589357 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12507-f7de-45ec-b753-1dda38793bdb None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:45.589628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12507-f7de-45ec-b753-1dda38793bdb None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:45.590244 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c12507-f7de-45ec-b753-1dda38793bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:45.591670 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c12507-f7de-45ec-b753-1dda38793bdb None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:45.598699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 262/536] 10.222.0.40 () {56 vars in 1087 bytes} [Sat Oct 29 20:31:45 2022] GET /identity/v3/services => generated 1002 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 20:31:45.600012 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b3cad-cb04-4034-a51b-2bc8faf9c9b8 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:45.600294 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b3cad-cb04-4034-a51b-2bc8faf9c9b8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:45.600563 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b3cad-cb04-4034-a51b-2bc8faf9c9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:45.624491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-1d0b3cad-cb04-4034-a51b-2bc8faf9c9b8 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:45.626479 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1d0b3cad-cb04-4034-a51b-2bc8faf9c9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:45.632137 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:45.642802 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:45.723186 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 263/537] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:45 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:31:45.748890 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af90060-bf35-4027-a1a5-576c5cdbddb3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:45.789757 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa0922-db65-41ab-a99a-6fa73d5cc96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:45.790297 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0922-db65-41ab-a99a-6fa73d5cc96c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:45.790575 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0922-db65-41ab-a99a-6fa73d5cc96c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:45.790849 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0922-db65-41ab-a99a-6fa73d5cc96c None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:45.791507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa0922-db65-41ab-a99a-6fa73d5cc96c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:45.793107 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa0922-db65-41ab-a99a-6fa73d5cc96c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:45.800347 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 275/538] 10.222.0.40 () {56 vars in 1087 bytes} [Sat Oct 29 20:31:45 2022] GET /identity/v3/services => generated 1002 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 20:31:46.072233 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b3cad-cb04-4034-a51b-2bc8faf9c9b8 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:46.179411 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b3cad-cb04-4034-a51b-2bc8faf9c9b8 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:46.216179 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb2e39-0b22-442d-b955-7e0b43dbbe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:46.216984 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb2e39-0b22-442d-b955-7e0b43dbbe68 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:46.217265 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb2e39-0b22-442d-b955-7e0b43dbbe68 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:46.217535 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb2e39-0b22-442d-b955-7e0b43dbbe68 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:46.218118 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb2e39-0b22-442d-b955-7e0b43dbbe68 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:46.220649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb2e39-0b22-442d-b955-7e0b43dbbe68 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-ddbb2e39-0b22-442d-b955-7e0b43dbbe68 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:46.230230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:46.231183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:46.233391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 264/539] 10.222.0.40 () {56 vars in 1132 bytes} [Sat Oct 29 20:31:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:46.239325 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa0922-db65-41ab-a99a-6fa73d5cc96c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:46.340138 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:46.348621 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa0922-db65-41ab-a99a-6fa73d5cc96c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:46.384735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e99cb7-f8c6-4d81-b4cc-70f0fc9da1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:46.385349 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99cb7-f8c6-4d81-b4cc-70f0fc9da1af None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:46.385629 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99cb7-f8c6-4d81-b4cc-70f0fc9da1af None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:46.385899 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99cb7-f8c6-4d81-b4cc-70f0fc9da1af None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:46.386531 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e99cb7-f8c6-4d81-b4cc-70f0fc9da1af None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:46.386834 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e99cb7-f8c6-4d81-b4cc-70f0fc9da1af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:46.388232 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e99cb7-f8c6-4d81-b4cc-70f0fc9da1af None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:46.393961 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 276/540] 10.222.0.40 () {56 vars in 1126 bytes} [Sat Oct 29 20:31:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:46.399406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb2e39-0b22-442d-b955-7e0b43dbbe68 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:46.415430 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:46.509506 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb2e39-0b22-442d-b955-7e0b43dbbe68 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:46.549866 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368bfcc-0ffd-4a18-a243-5502b7657072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:46.550470 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368bfcc-0ffd-4a18-a243-5502b7657072 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:46.550748 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368bfcc-0ffd-4a18-a243-5502b7657072 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:46.551023 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368bfcc-0ffd-4a18-a243-5502b7657072 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:46.551689 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368bfcc-0ffd-4a18-a243-5502b7657072 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:46.551995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368bfcc-0ffd-4a18-a243-5502b7657072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:46.553362 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368bfcc-0ffd-4a18-a243-5502b7657072 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:46.558393 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 265/541] 10.222.0.40 () {56 vars in 1126 bytes} [Sat Oct 29 20:31:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:47.968411 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a360d-43c7-4351-aec2-15d8cb322717 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:47.969316 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a360d-43c7-4351-aec2-15d8cb322717 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:47.969775 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a360d-43c7-4351-aec2-15d8cb322717 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:47.971574 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 277/542] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:47.977244 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e0d03-8a8e-4eef-9652-e107f00d9c89 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:47.978110 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e0d03-8a8e-4eef-9652-e107f00d9c89 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:47.978584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e0d03-8a8e-4eef-9652-e107f00d9c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:47.997576 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-998e0d03-8a8e-4eef-9652-e107f00d9c89 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:47.999050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-998e0d03-8a8e-4eef-9652-e107f00d9c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:48.070848 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 266/543] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:31:48.132658 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc46884-09df-4d5e-8b32-e60905986155 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:48.132986 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc46884-09df-4d5e-8b32-e60905986155 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:48.133218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc46884-09df-4d5e-8b32-e60905986155 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:48.134810 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 278/544] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:48.140411 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5d7c4-7c32-4950-af70-0a28f287fa37 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:48.140695 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5d7c4-7c32-4950-af70-0a28f287fa37 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:48.141169 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5d7c4-7c32-4950-af70-0a28f287fa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:48.153793 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:48.160476 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e5b5d7c4-7c32-4950-af70-0a28f287fa37 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:48.161652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e5b5d7c4-7c32-4950-af70-0a28f287fa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:48.232612 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 267/545] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:48 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:31:48.303151 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d2d21-f114-4c5d-8d3a-ab0aca3116b6 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:48.303813 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d2d21-f114-4c5d-8d3a-ab0aca3116b6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:48.304313 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d2d21-f114-4c5d-8d3a-ab0aca3116b6 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:48.306152 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 279/546] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:48.311560 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99b290-f6e4-42d0-ba49-14112c5ade4d None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:48.312062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99b290-f6e4-42d0-ba49-14112c5ade4d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:48.312540 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99b290-f6e4-42d0-ba49-14112c5ade4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:48.331427 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0d99b290-f6e4-42d0-ba49-14112c5ade4d None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:48.332907 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0d99b290-f6e4-42d0-ba49-14112c5ade4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:48.401751 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 268/547] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:48 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:31:48.418038 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d2d21-f114-4c5d-8d3a-ab0aca3116b6 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:48.529888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d2d21-f114-4c5d-8d3a-ab0aca3116b6 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:48.566194 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c9563-6d34-469c-b091-f6fc6b71fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:48.566829 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9563-6d34-469c-b091-f6fc6b71fa3d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:48.567106 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9563-6d34-469c-b091-f6fc6b71fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:48.567408 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9563-6d34-469c-b091-f6fc6b71fa3d None admin] PATH_INFO: `/v3/services/image` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:48.568049 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c9563-6d34-469c-b091-f6fc6b71fa3d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:48.569484 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c9563-6d34-469c-b091-f6fc6b71fa3d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-603c9563-6d34-469c-b091-f6fc6b71fa3d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:48.579320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:48.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:48.581111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 280/548] 10.222.0.40 () {56 vars in 1105 bytes} [Sat Oct 29 20:31:48 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:48.586346 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99b290-f6e4-42d0-ba49-14112c5ade4d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:48.598025 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c9563-6d34-469c-b091-f6fc6b71fa3d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:48.643884 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:48.664309 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:48.702938 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99b290-f6e4-42d0-ba49-14112c5ade4d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:48.742887 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c9563-6d34-469c-b091-f6fc6b71fa3d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:48.747907 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e1527-9764-43d2-a70b-1fa3980701d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:48.748517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e1527-9764-43d2-a70b-1fa3980701d5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:48.748794 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e1527-9764-43d2-a70b-1fa3980701d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:48.749063 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e1527-9764-43d2-a70b-1fa3980701d5 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:48.749697 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e1527-9764-43d2-a70b-1fa3980701d5 None admin] RBAC: Adding query filter params (name=image) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:48.750059 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e1527-9764-43d2-a70b-1fa3980701d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:48.752448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e1527-9764-43d2-a70b-1fa3980701d5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:48.759449 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 269/549] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:48.760263 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e1527-9764-43d2-a70b-1fa3980701d5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:48.782014 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0115124-c58c-4e55-a990-4ec2498344e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:48.782722 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115124-c58c-4e55-a990-4ec2498344e5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:48.782911 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115124-c58c-4e55-a990-4ec2498344e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:48.783499 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115124-c58c-4e55-a990-4ec2498344e5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:48.783942 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0115124-c58c-4e55-a990-4ec2498344e5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:48.785462 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0115124-c58c-4e55-a990-4ec2498344e5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-e0115124-c58c-4e55-a990-4ec2498344e5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:48.795251 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:48.796683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:48.797711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 281/550] 10.222.0.40 () {56 vars in 1129 bytes} [Sat Oct 29 20:31:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:31:48.798496 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0115124-c58c-4e55-a990-4ec2498344e5 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:48.870987 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e1527-9764-43d2-a70b-1fa3980701d5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:48.887458 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:48.902007 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:48.905058 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0115124-c58c-4e55-a990-4ec2498344e5 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:48.909984 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56555dc-376d-44ea-ae5c-d988de8a8993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:48.910618 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56555dc-376d-44ea-ae5c-d988de8a8993 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:48.910899 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56555dc-376d-44ea-ae5c-d988de8a8993 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:48.911170 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56555dc-376d-44ea-ae5c-d988de8a8993 None admin] PATH_INFO: `/v3/services/network` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:48.911794 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56555dc-376d-44ea-ae5c-d988de8a8993 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:48.913156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56555dc-376d-44ea-ae5c-d988de8a8993 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-c56555dc-376d-44ea-ae5c-d988de8a8993 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:48.924323 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:48.925492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:48.926501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 270/551] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:48 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:48.931040 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56555dc-376d-44ea-ae5c-d988de8a8993 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:48.952937 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8059ce-a239-4176-81ab-bad27f348092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:48.953756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8059ce-a239-4176-81ab-bad27f348092 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:48.953756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8059ce-a239-4176-81ab-bad27f348092 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:48.954363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8059ce-a239-4176-81ab-bad27f348092 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:48.954939 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8059ce-a239-4176-81ab-bad27f348092 None admin] RBAC: Adding query filter params (type=image) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:48.955062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8059ce-a239-4176-81ab-bad27f348092 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:48.956480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8059ce-a239-4176-81ab-bad27f348092 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:48.966298 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 282/552] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:48.966298 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8059ce-a239-4176-81ab-bad27f348092 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:49.045068 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56555dc-376d-44ea-ae5c-d988de8a8993 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:49.071696 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8059ce-a239-4176-81ab-bad27f348092 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:49.080456 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93aeb5-5d77-44b4-8a42-b047dd5f7ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:49.081051 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93aeb5-5d77-44b4-8a42-b047dd5f7ad3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:49.081324 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93aeb5-5d77-44b4-8a42-b047dd5f7ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:49.081592 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93aeb5-5d77-44b4-8a42-b047dd5f7ad3 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:49.082218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93aeb5-5d77-44b4-8a42-b047dd5f7ad3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:49.082512 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93aeb5-5d77-44b4-8a42-b047dd5f7ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:49.083906 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93aeb5-5d77-44b4-8a42-b047dd5f7ad3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:49.088254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 271/553] 10.222.0.40 () {56 vars in 1124 bytes} [Sat Oct 29 20:31:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:49.089073 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93aeb5-5d77-44b4-8a42-b047dd5f7ad3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:49.106850 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f7623-376c-4616-a6b5-921ff3e1fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:49.107488 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f7623-376c-4616-a6b5-921ff3e1fca8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:49.107774 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f7623-376c-4616-a6b5-921ff3e1fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:49.108046 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f7623-376c-4616-a6b5-921ff3e1fca8 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:49.108664 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f7623-376c-4616-a6b5-921ff3e1fca8 None admin] RBAC: Adding query filter params (name=network) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:49.108981 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f7623-376c-4616-a6b5-921ff3e1fca8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:49.110502 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f7623-376c-4616-a6b5-921ff3e1fca8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:49.115055 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 283/554] 10.222.0.40 () {56 vars in 1112 bytes} [Sat Oct 29 20:31:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:49.116312 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d0220-a816-46a9-b9ee-9193446923d0 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:49.116599 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d0220-a816-46a9-b9ee-9193446923d0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:49.116870 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d0220-a816-46a9-b9ee-9193446923d0 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:49.118038 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 284/555] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:49.119439 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d0220-a816-46a9-b9ee-9193446923d0 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:49.135125 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:49.153955 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:49.197407 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93aeb5-5d77-44b4-8a42-b047dd5f7ad3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:49.221652 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d0220-a816-46a9-b9ee-9193446923d0 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:49.230538 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571b6f5-004c-4452-bb07-fccdb47a6989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:49.231137 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571b6f5-004c-4452-bb07-fccdb47a6989 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:49.231449 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571b6f5-004c-4452-bb07-fccdb47a6989 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:49.231723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571b6f5-004c-4452-bb07-fccdb47a6989 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:49.232387 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571b6f5-004c-4452-bb07-fccdb47a6989 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:49.233741 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571b6f5-004c-4452-bb07-fccdb47a6989 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:49.257494 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ae5b1-0f47-4fc0-be8c-d04f78c18d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:49.258102 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ae5b1-0f47-4fc0-be8c-d04f78c18d55 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:49.258376 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ae5b1-0f47-4fc0-be8c-d04f78c18d55 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:49.258638 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ae5b1-0f47-4fc0-be8c-d04f78c18d55 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:49.266595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 272/556] 10.222.0.40 () {60 vars in 1144 bytes} [Sat Oct 29 20:31:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:31:49.266911 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ae5b1-0f47-4fc0-be8c-d04f78c18d55 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:49.266911 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ae5b1-0f47-4fc0-be8c-d04f78c18d55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:49.267062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571b6f5-004c-4452-bb07-fccdb47a6989 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:49.267144 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ae5b1-0f47-4fc0-be8c-d04f78c18d55 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:49.267144 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 285/557] 10.222.0.40 () {56 vars in 1124 bytes} [Sat Oct 29 20:31:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:49.267565 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365be7e2-dff4-40d3-88a2-716b4dde3593 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:49.267908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365be7e2-dff4-40d3-88a2-716b4dde3593 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:49.268284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365be7e2-dff4-40d3-88a2-716b4dde3593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:49.288203 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-365be7e2-dff4-40d3-88a2-716b4dde3593 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:49.289409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-365be7e2-dff4-40d3-88a2-716b4dde3593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:49.395341 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 286/558] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:49 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:31:49.395341 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365be7e2-dff4-40d3-88a2-716b4dde3593 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:49.399215 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:49.424587 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571b6f5-004c-4452-bb07-fccdb47a6989 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:49.457045 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:49.500151 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b9934-7619-44e6-a1d2-77e79230ec71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:49.501378 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b9934-7619-44e6-a1d2-77e79230ec71 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:49.507322 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b9934-7619-44e6-a1d2-77e79230ec71 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:49.507322 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b9934-7619-44e6-a1d2-77e79230ec71 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:49.507322 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b9934-7619-44e6-a1d2-77e79230ec71 None admin] RBAC: Adding query filter params (type=network) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:49.507322 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b9934-7619-44e6-a1d2-77e79230ec71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:49.507322 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b9934-7619-44e6-a1d2-77e79230ec71 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:49.513702 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 273/559] 10.222.0.40 () {56 vars in 1112 bytes} [Sat Oct 29 20:31:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:49.518519 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b9934-7619-44e6-a1d2-77e79230ec71 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:49.598316 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365be7e2-dff4-40d3-88a2-716b4dde3593 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:49.663843 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b9934-7619-44e6-a1d2-77e79230ec71 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:49.670053 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c849f-5a5d-4e6d-87dd-f507fb76ca3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:49.670674 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c849f-5a5d-4e6d-87dd-f507fb76ca3b None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:49.670953 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c849f-5a5d-4e6d-87dd-f507fb76ca3b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:49.671223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c849f-5a5d-4e6d-87dd-f507fb76ca3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:49.672360 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c849f-5a5d-4e6d-87dd-f507fb76ca3b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:49.673751 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c849f-5a5d-4e6d-87dd-f507fb76ca3b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:49.729870 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a844c-5378-4642-8bbc-96768a3bb059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:49.729870 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a844c-5378-4642-8bbc-96768a3bb059 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:49.729870 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a844c-5378-4642-8bbc-96768a3bb059 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:49.729870 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a844c-5378-4642-8bbc-96768a3bb059 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:49.730334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a844c-5378-4642-8bbc-96768a3bb059 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:49.730415 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 287/560] 10.222.0.40 () {60 vars in 1144 bytes} [Sat Oct 29 20:31:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:31:49.730625 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a844c-5378-4642-8bbc-96768a3bb059 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:49.732452 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c849f-5a5d-4e6d-87dd-f507fb76ca3b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:49.770023 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 274/561] 10.222.0.40 () {60 vars in 1144 bytes} [Sat Oct 29 20:31:49 2022] POST /identity/v3/endpoints => generated 337 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:31:49.830757 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:49.907497 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c849f-5a5d-4e6d-87dd-f507fb76ca3b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:49.963332 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe113bed-01a7-4f81-bec0-b3039e92f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:49.963886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe113bed-01a7-4f81-bec0-b3039e92f82c None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:49.964165 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe113bed-01a7-4f81-bec0-b3039e92f82c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:49.964434 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe113bed-01a7-4f81-bec0-b3039e92f82c None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:49.965103 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe113bed-01a7-4f81-bec0-b3039e92f82c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:49.966584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe113bed-01a7-4f81-bec0-b3039e92f82c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:49.991392 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 288/562] 10.222.0.40 () {60 vars in 1141 bytes} [Sat Oct 29 20:31:49 2022] POST /identity/v3/services => generated 269 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:31:51.852359 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196d0f6-c697-4fe5-94c0-91d7e8a7dcc8 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:51.853325 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196d0f6-c697-4fe5-94c0-91d7e8a7dcc8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:51.853808 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196d0f6-c697-4fe5-94c0-91d7e8a7dcc8 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:51.855661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 275/563] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:51.860888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb331ce-a797-4b03-8be9-1f8eca8f699e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:51.861324 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb331ce-a797-4b03-8be9-1f8eca8f699e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:51.861432 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb331ce-a797-4b03-8be9-1f8eca8f699e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:51.881340 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-cbb331ce-a797-4b03-8be9-1f8eca8f699e None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:51.882539 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-cbb331ce-a797-4b03-8be9-1f8eca8f699e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:51.956662 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 289/564] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:51 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:31:52.207815 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63280cb1-bbad-4171-a49e-f41f904217f0 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:52.208094 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63280cb1-bbad-4171-a49e-f41f904217f0 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:52.208531 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63280cb1-bbad-4171-a49e-f41f904217f0 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:52.209893 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 276/565] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:52.214983 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330fce6-f9a2-48aa-86e7-2bc767f32531 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:52.215264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330fce6-f9a2-48aa-86e7-2bc767f32531 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:52.215568 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330fce6-f9a2-48aa-86e7-2bc767f32531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:52.233986 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0330fce6-f9a2-48aa-86e7-2bc767f32531 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:52.235723 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0330fce6-f9a2-48aa-86e7-2bc767f32531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:52.270302 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:52.277011 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63280cb1-bbad-4171-a49e-f41f904217f0 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:52.312731 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 290/566] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:52 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:31:52.314317 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:52.384863 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63280cb1-bbad-4171-a49e-f41f904217f0 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:52.419111 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91d1ec-e535-4496-be78-bf2a733f9534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:52.419741 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d1ec-e535-4496-be78-bf2a733f9534 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:52.420021 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d1ec-e535-4496-be78-bf2a733f9534 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:52.420295 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d1ec-e535-4496-be78-bf2a733f9534 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:52.420958 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91d1ec-e535-4496-be78-bf2a733f9534 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:52.422888 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91d1ec-e535-4496-be78-bf2a733f9534 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:52.430756 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.sql.core [None req-0b91d1ec-e535-4496-be78-bf2a733f9534 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 29 20:31:52.430756 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 20:31:52.430756 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [parameters: {'id': '356bca4ea3f3417db8e0d2bc3289e2c7', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 29 20:31:52.430756 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88417) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 20:31:52.438872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-0b91d1ec-e535-4496-be78-bf2a733f9534 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 29 20:31:52.438872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:52.438872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 20:31:52.438872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 20:31:52.438872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 20:31:52.438872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 20:31:52.438872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 20:31:52.438872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 20:31:52.438872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 20:31:52.438872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application conn.query(q) Oct 29 20:31:52.438872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 20:31:52.438872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 20:31:52.438872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 20:31:52.438872 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application result.read() Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 29 20:31:52.439800 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application next(self.gen) Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application yield resource Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application next(self.gen) Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.session.rollback() Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.force_reraise() Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise self.value Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application session.commit() Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 29 20:31:52.440792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._prepare_impl() Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.session.flush() Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._flush(objects) Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application compat.raise_( Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application flush_context.execute() Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rec.execute(self) Oct 29 20:31:52.441655 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 20:31:52.444284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application conn.query(q) Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application result.read() Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 20:31:52.446156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [parameters: {'id': '356bca4ea3f3417db8e0d2bc3289e2c7', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 29 20:31:52.448256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:52.450046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:52.455056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 29 20:31:52.455056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 29 20:31:52.455056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:52.455056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:52.455056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 29 20:31:52.455056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 29 20:31:52.455056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:52.455056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:52.455056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 29 20:31:52.455056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 29 20:31:52.455056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 29 20:31:52.455056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:52.455056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 277/567] 10.222.0.40 () {60 vars in 1137 bytes} [Sat Oct 29 20:31:52 2022] POST /identity/v3/domains => generated 190 bytes in 168 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:52.456713 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330fce6-f9a2-48aa-86e7-2bc767f32531 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:52.456873 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124919b-b440-48af-9777-4f0995f16bff None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:52.456873 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124919b-b440-48af-9777-4f0995f16bff None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:52.456873 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124919b-b440-48af-9777-4f0995f16bff None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:52.456873 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 278/568] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:52.460049 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59cc07-4643-45df-a277-d360800c0369 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:52.460267 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59cc07-4643-45df-a277-d360800c0369 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:52.460535 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59cc07-4643-45df-a277-d360800c0369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:52.480653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-8b59cc07-4643-45df-a277-d360800c0369 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:52.481821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8b59cc07-4643-45df-a277-d360800c0369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:52.552750 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 279/569] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:52 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:31:52.562039 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330fce6-f9a2-48aa-86e7-2bc767f32531 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:52.599140 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fea54-bff8-4e32-937e-c6607996aeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:52.599801 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fea54-bff8-4e32-937e-c6607996aeb6 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:52.600071 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fea54-bff8-4e32-937e-c6607996aeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:52.600375 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fea54-bff8-4e32-937e-c6607996aeb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:52.611847 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fea54-bff8-4e32-937e-c6607996aeb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:52.613281 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fea54-bff8-4e32-937e-c6607996aeb6 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-a63fea54-bff8-4e32-937e-c6607996aeb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:31:52.628794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:52.629736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:31:52.630601 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:31:52.630601 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:31:52.630601 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:52.630601 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 291/570] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:52.637037 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59cc07-4643-45df-a277-d360800c0369 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:52.644736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fea54-bff8-4e32-937e-c6607996aeb6 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:52.667481 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:52.671900 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:52.755132 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59cc07-4643-45df-a277-d360800c0369 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:52.762490 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fea54-bff8-4e32-937e-c6607996aeb6 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:52.791186 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83381db0-7209-4c38-80fb-cddbd1c3a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:52.792119 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83381db0-7209-4c38-80fb-cddbd1c3a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:52.792591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83381db0-7209-4c38-80fb-cddbd1c3a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:52.793034 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83381db0-7209-4c38-80fb-cddbd1c3a4c6 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:52.793903 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83381db0-7209-4c38-80fb-cddbd1c3a4c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:52.794394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83381db0-7209-4c38-80fb-cddbd1c3a4c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:52.797780 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83381db0-7209-4c38-80fb-cddbd1c3a4c6 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:52.803637 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe2049-2fb7-4a8c-be0a-8b8a74d2c5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:52.804380 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe2049-2fb7-4a8c-be0a-8b8a74d2c5eb None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:52.804661 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe2049-2fb7-4a8c-be0a-8b8a74d2c5eb None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:52.804931 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe2049-2fb7-4a8c-be0a-8b8a74d2c5eb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:52.805523 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe2049-2fb7-4a8c-be0a-8b8a74d2c5eb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:52.806890 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe2049-2fb7-4a8c-be0a-8b8a74d2c5eb None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-4bfe2049-2fb7-4a8c-be0a-8b8a74d2c5eb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:52.816894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:52.817917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:52.818746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:52.818746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:52.818746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:52.818746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:52.818746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:52.818746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:52.818746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:52.818746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:52.818746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:52.818746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:52.818746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:31:52.818746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:52.818746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 20:31:52.818746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:31:52.823442 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 292/571] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:31:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:31:52.823629 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 280/572] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:52.824584 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe2049-2fb7-4a8c-be0a-8b8a74d2c5eb None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:52.887206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83381db0-7209-4c38-80fb-cddbd1c3a4c6 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:52.921802 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:52.945349 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe2049-2fb7-4a8c-be0a-8b8a74d2c5eb None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:52.983412 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3d9e6-41e7-462b-b976-84824676c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:52.984031 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3d9e6-41e7-462b-b976-84824676c538 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:52.984310 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3d9e6-41e7-462b-b976-84824676c538 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:52.985582 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3d9e6-41e7-462b-b976-84824676c538 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:52.986310 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:52.986450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3d9e6-41e7-462b-b976-84824676c538 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:52.986606 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3d9e6-41e7-462b-b976-84824676c538 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:52.988074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3d9e6-41e7-462b-b976-84824676c538 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:52.993917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 293/573] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:31:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:52.999744 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3d9e6-41e7-462b-b976-84824676c538 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:53.001046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83381db0-7209-4c38-80fb-cddbd1c3a4c6 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:53.043129 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b290467-f4e2-4109-b981-5a2d12b17557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:53.044152 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b290467-f4e2-4109-b981-5a2d12b17557 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:53.044152 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b290467-f4e2-4109-b981-5a2d12b17557 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:53.044317 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b290467-f4e2-4109-b981-5a2d12b17557 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:53.044813 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b290467-f4e2-4109-b981-5a2d12b17557 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:53.046174 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b290467-f4e2-4109-b981-5a2d12b17557 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-4b290467-f4e2-4109-b981-5a2d12b17557 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:53.056591 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:53.057533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:53.058437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 281/574] 10.222.0.40 () {56 vars in 1132 bytes} [Sat Oct 29 20:31:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:31:53.063937 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b290467-f4e2-4109-b981-5a2d12b17557 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:53.127088 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3d9e6-41e7-462b-b976-84824676c538 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:53.173803 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a7161-62ab-4d11-810a-6e59427fadba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:53.174418 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a7161-62ab-4d11-810a-6e59427fadba None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:53.174694 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a7161-62ab-4d11-810a-6e59427fadba None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:53.174958 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a7161-62ab-4d11-810a-6e59427fadba None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:53.175825 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a7161-62ab-4d11-810a-6e59427fadba None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:53.175970 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a7161-62ab-4d11-810a-6e59427fadba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:53.177346 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a7161-62ab-4d11-810a-6e59427fadba None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:53.181855 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 294/575] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:31:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:53.184996 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b290467-f4e2-4109-b981-5a2d12b17557 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:53.224116 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb000e59-c4a1-4305-b71f-bc4698f881a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:53.224741 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb000e59-c4a1-4305-b71f-bc4698f881a5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:53.225018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb000e59-c4a1-4305-b71f-bc4698f881a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:53.225297 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb000e59-c4a1-4305-b71f-bc4698f881a5 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:53.225941 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb000e59-c4a1-4305-b71f-bc4698f881a5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:53.226239 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb000e59-c4a1-4305-b71f-bc4698f881a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:53.227700 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb000e59-c4a1-4305-b71f-bc4698f881a5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:53.232967 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 282/576] 10.222.0.40 () {56 vars in 1126 bytes} [Sat Oct 29 20:31:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:53.239264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a7161-62ab-4d11-810a-6e59427fadba None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:53.259583 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:53.354510 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a7161-62ab-4d11-810a-6e59427fadba None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:53.391598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1ce2b-a340-4402-b4a6-cb498e4c7b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:53.392363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1ce2b-a340-4402-b4a6-cb498e4c7b47 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:53.392640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1ce2b-a340-4402-b4a6-cb498e4c7b47 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:53.392904 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1ce2b-a340-4402-b4a6-cb498e4c7b47 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:53.393538 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1ce2b-a340-4402-b4a6-cb498e4c7b47 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:53.393836 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1ce2b-a340-4402-b4a6-cb498e4c7b47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:53.395223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1ce2b-a340-4402-b4a6-cb498e4c7b47 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:53.401960 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 295/577] 10.222.0.40 () {56 vars in 1126 bytes} [Sat Oct 29 20:31:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:53.408226 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb000e59-c4a1-4305-b71f-bc4698f881a5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:53.427108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:53.510444 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb000e59-c4a1-4305-b71f-bc4698f881a5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:53.545373 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7f200-328b-4eda-a4d4-f93cd24eae1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:53.545974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7f200-328b-4eda-a4d4-f93cd24eae1f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:53.546251 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7f200-328b-4eda-a4d4-f93cd24eae1f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:53.546782 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7f200-328b-4eda-a4d4-f93cd24eae1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:53.548294 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7f200-328b-4eda-a4d4-f93cd24eae1f None admin] RBAC: Adding query filter params (interface=public, service_id=936da57360bd4759981e6d7e8fcc9436, region_id=RegionOne) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:53.548601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7f200-328b-4eda-a4d4-f93cd24eae1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:53.550033 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7f200-328b-4eda-a4d4-f93cd24eae1f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:53.554989 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 283/578] 10.222.0.40 () {56 vars in 1251 bytes} [Sat Oct 29 20:31:53 2022] GET /identity/v3/endpoints?service_id=936da57360bd4759981e6d7e8fcc9436&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:53.560641 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1ce2b-a340-4402-b4a6-cb498e4c7b47 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:53.636954 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:53.660599 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1ce2b-a340-4402-b4a6-cb498e4c7b47 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:53.695170 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc613397-85c1-491c-b7a4-b376efa30989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:53.695809 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc613397-85c1-491c-b7a4-b376efa30989 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:53.696087 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc613397-85c1-491c-b7a4-b376efa30989 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:53.696355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc613397-85c1-491c-b7a4-b376efa30989 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:53.696955 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc613397-85c1-491c-b7a4-b376efa30989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:53.698318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc613397-85c1-491c-b7a4-b376efa30989 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:53.704293 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 296/579] 10.222.0.40 () {56 vars in 1087 bytes} [Sat Oct 29 20:31:53 2022] GET /identity/v3/services => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 20:31:55.575326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c4bfe-3560-40f3-9824-0556e5965de3 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:55.575852 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c4bfe-3560-40f3-9824-0556e5965de3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:55.575852 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c4bfe-3560-40f3-9824-0556e5965de3 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:55.577179 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 284/580] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:55.582575 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93014c7a-a4c3-439d-a5e1-3657aeacaaf6 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:55.582977 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93014c7a-a4c3-439d-a5e1-3657aeacaaf6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:55.583111 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93014c7a-a4c3-439d-a5e1-3657aeacaaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:55.601534 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-93014c7a-a4c3-439d-a5e1-3657aeacaaf6 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:55.602683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-93014c7a-a4c3-439d-a5e1-3657aeacaaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:55.668271 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 297/581] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:55 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:31:55.986386 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c4bfe-3560-40f3-9824-0556e5965de3 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:56.068258 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:56.088483 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c4bfe-3560-40f3-9824-0556e5965de3 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:56.096699 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bffdab-c981-4989-9749-1d787a4416c9 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:56.097082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bffdab-c981-4989-9749-1d787a4416c9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:56.097362 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bffdab-c981-4989-9749-1d787a4416c9 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:56.098700 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 298/582] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:31:56.103620 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccf6d3-28b3-4409-86a3-b5ee9330281d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:56.103904 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccf6d3-28b3-4409-86a3-b5ee9330281d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:56.104177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccf6d3-28b3-4409-86a3-b5ee9330281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:56.122513 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-e7ccf6d3-28b3-4409-86a3-b5ee9330281d None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:56.123023 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45546e-89c8-4892-8429-ae6a1820159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:56.123652 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45546e-89c8-4892-8429-ae6a1820159f None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:56.123774 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e7ccf6d3-28b3-4409-86a3-b5ee9330281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:56.123925 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45546e-89c8-4892-8429-ae6a1820159f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:56.124190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45546e-89c8-4892-8429-ae6a1820159f None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:56.124838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45546e-89c8-4892-8429-ae6a1820159f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:56.127250 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45546e-89c8-4892-8429-ae6a1820159f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:56.141894 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 285/583] 10.222.0.40 () {60 vars in 1141 bytes} [Sat Oct 29 20:31:55 2022] POST /identity/v3/services => generated 251 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:31:56.195614 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:56.207327 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 299/584] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:56 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 20:31:56.533703 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45546e-89c8-4892-8429-ae6a1820159f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:56.630648 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45546e-89c8-4892-8429-ae6a1820159f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:56.663376 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca656a-16be-4c94-995f-a2021cb4d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:56.664007 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca656a-16be-4c94-995f-a2021cb4d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:56.664275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca656a-16be-4c94-995f-a2021cb4d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:56.664538 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca656a-16be-4c94-995f-a2021cb4d2b2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:56.665116 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca656a-16be-4c94-995f-a2021cb4d2b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:56.666469 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca656a-16be-4c94-995f-a2021cb4d2b2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-41ca656a-16be-4c94-995f-a2021cb4d2b2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:56.675931 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:56.676853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:56.677749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 286/585] 10.222.0.40 () {56 vars in 1132 bytes} [Sat Oct 29 20:31:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:56.682817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ccf6d3-28b3-4409-86a3-b5ee9330281d None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:56.781948 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ccf6d3-28b3-4409-86a3-b5ee9330281d None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:56.815762 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030fcad-58cb-401f-8d1a-3430b2e40ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:56.816306 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030fcad-58cb-401f-8d1a-3430b2e40ad1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:56.816583 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030fcad-58cb-401f-8d1a-3430b2e40ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:56.816852 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030fcad-58cb-401f-8d1a-3430b2e40ad1 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:56.817474 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030fcad-58cb-401f-8d1a-3430b2e40ad1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:56.817775 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030fcad-58cb-401f-8d1a-3430b2e40ad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:56.819148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030fcad-58cb-401f-8d1a-3430b2e40ad1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:56.823804 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 300/586] 10.222.0.40 () {56 vars in 1126 bytes} [Sat Oct 29 20:31:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:56.829554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca656a-16be-4c94-995f-a2021cb4d2b2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:56.833841 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:56.932730 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca656a-16be-4c94-995f-a2021cb4d2b2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:56.965632 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108f312-5f3f-418c-ae35-a18df71c310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:56.966226 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108f312-5f3f-418c-ae35-a18df71c310c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:56.966499 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108f312-5f3f-418c-ae35-a18df71c310c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:56.966765 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108f312-5f3f-418c-ae35-a18df71c310c None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:56.967425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108f312-5f3f-418c-ae35-a18df71c310c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:56.967721 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108f312-5f3f-418c-ae35-a18df71c310c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:56.969596 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108f312-5f3f-418c-ae35-a18df71c310c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:56.974155 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 287/587] 10.222.0.40 () {56 vars in 1126 bytes} [Sat Oct 29 20:31:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:31:56.979830 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030fcad-58cb-401f-8d1a-3430b2e40ad1 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:57.038068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:57.079891 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030fcad-58cb-401f-8d1a-3430b2e40ad1 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:57.114105 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7522200-1c12-4e36-b437-e6618a302e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:57.114705 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7522200-1c12-4e36-b437-e6618a302e09 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:57.114980 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7522200-1c12-4e36-b437-e6618a302e09 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:57.115249 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7522200-1c12-4e36-b437-e6618a302e09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:57.115937 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7522200-1c12-4e36-b437-e6618a302e09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:57.117294 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7522200-1c12-4e36-b437-e6618a302e09 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:57.136529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 301/588] 10.222.0.40 () {60 vars in 1144 bytes} [Sat Oct 29 20:31:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 20:31:58.571372 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45641c3-8499-4f06-a3eb-f041703fce22 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:58.571870 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45641c3-8499-4f06-a3eb-f041703fce22 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:58.571870 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45641c3-8499-4f06-a3eb-f041703fce22 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:58.573276 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 288/589] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:31:58.578435 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23dbb6-7a4d-4deb-b689-302ba3da7499 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:58.579012 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23dbb6-7a4d-4deb-b689-302ba3da7499 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:58.579335 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23dbb6-7a4d-4deb-b689-302ba3da7499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:58.598114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0e23dbb6-7a4d-4deb-b689-302ba3da7499 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:58.599281 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0e23dbb6-7a4d-4deb-b689-302ba3da7499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:58.670136 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 302/590] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:58 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:31:58.993384 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45641c3-8499-4f06-a3eb-f041703fce22 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:59.059560 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:59.093330 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45641c3-8499-4f06-a3eb-f041703fce22 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:59.126987 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5e6be-0e1f-48fb-ad28-49f0d00e1cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:59.127640 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5e6be-0e1f-48fb-ad28-49f0d00e1cea None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:59.127938 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5e6be-0e1f-48fb-ad28-49f0d00e1cea None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:59.128183 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5e6be-0e1f-48fb-ad28-49f0d00e1cea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:59.128769 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5e6be-0e1f-48fb-ad28-49f0d00e1cea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:59.130166 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5e6be-0e1f-48fb-ad28-49f0d00e1cea None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-7ed5e6be-0e1f-48fb-ad28-49f0d00e1cea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:31:59.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:31:59.141079 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:31:59.142090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 289/591] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:31:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:31:59.147564 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23dbb6-7a4d-4deb-b689-302ba3da7499 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:59.192266 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:59.249546 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23dbb6-7a4d-4deb-b689-302ba3da7499 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:59.286387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdb42a-5fd2-46c6-b383-e75edef02a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:59.287020 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdb42a-5fd2-46c6-b383-e75edef02a9e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:59.287323 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdb42a-5fd2-46c6-b383-e75edef02a9e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:59.287592 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdb42a-5fd2-46c6-b383-e75edef02a9e None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:59.288218 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdb42a-5fd2-46c6-b383-e75edef02a9e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:59.288517 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdb42a-5fd2-46c6-b383-e75edef02a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:59.289896 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdb42a-5fd2-46c6-b383-e75edef02a9e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:59.294754 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 303/592] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:31:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:59.300558 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5e6be-0e1f-48fb-ad28-49f0d00e1cea None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:59.401554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5e6be-0e1f-48fb-ad28-49f0d00e1cea None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:59.430087 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:59.435908 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d500c-eaba-4cc9-892c-8ac2f21c1a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:59.436500 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d500c-eaba-4cc9-892c-8ac2f21c1a24 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:59.436771 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d500c-eaba-4cc9-892c-8ac2f21c1a24 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:59.437034 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d500c-eaba-4cc9-892c-8ac2f21c1a24 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:59.438277 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d500c-eaba-4cc9-892c-8ac2f21c1a24 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:59.438578 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d500c-eaba-4cc9-892c-8ac2f21c1a24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:59.439972 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d500c-eaba-4cc9-892c-8ac2f21c1a24 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:59.444705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 290/593] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:31:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:59.450656 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdb42a-5fd2-46c6-b383-e75edef02a9e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:59.549093 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdb42a-5fd2-46c6-b383-e75edef02a9e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:59.556831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:31:59.571531 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b7c42-5c3a-40bb-a16f-c3b5e4f9a9fc None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:59.572070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b7c42-5c3a-40bb-a16f-c3b5e4f9a9fc None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:59.572070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b7c42-5c3a-40bb-a16f-c3b5e4f9a9fc None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:59.573407 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 291/594] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:31:59.578490 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ffecd-4c68-46e5-a061-b1ed81563562 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:59.578772 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ffecd-4c68-46e5-a061-b1ed81563562 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:59.579048 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ffecd-4c68-46e5-a061-b1ed81563562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:59.586837 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b170eb-b5e4-4aee-a26e-b60651b9b10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:59.587469 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b170eb-b5e4-4aee-a26e-b60651b9b10a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:59.587742 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b170eb-b5e4-4aee-a26e-b60651b9b10a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:59.588006 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b170eb-b5e4-4aee-a26e-b60651b9b10a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:59.588767 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b170eb-b5e4-4aee-a26e-b60651b9b10a None admin] RBAC: Adding query filter params (interface=public, service_id=c05f648f91544242a85b50fc87d01ecb, region_id=RegionOne) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:31:59.589073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b170eb-b5e4-4aee-a26e-b60651b9b10a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:59.590429 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b170eb-b5e4-4aee-a26e-b60651b9b10a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:59.595643 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 304/595] 10.222.0.40 () {56 vars in 1251 bytes} [Sat Oct 29 20:31:59 2022] GET /identity/v3/endpoints?service_id=c05f648f91544242a85b50fc87d01ecb&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:31:59.597221 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-ad2ffecd-4c68-46e5-a061-b1ed81563562 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:31:59.598412 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ad2ffecd-4c68-46e5-a061-b1ed81563562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:31:59.601351 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b170eb-b5e4-4aee-a26e-b60651b9b10a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:31:59.665454 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 292/596] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:31:59 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 20:31:59.700093 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b170eb-b5e4-4aee-a26e-b60651b9b10a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:31:59.733585 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081c427-bcc4-4559-b4da-a607842ddba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:31:59.734189 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081c427-bcc4-4559-b4da-a607842ddba3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:31:59.734492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081c427-bcc4-4559-b4da-a607842ddba3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:31:59.734762 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081c427-bcc4-4559-b4da-a607842ddba3 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:31:59.735392 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081c427-bcc4-4559-b4da-a607842ddba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:31:59.736769 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081c427-bcc4-4559-b4da-a607842ddba3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:31:59.742529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 305/597] 10.222.0.40 () {56 vars in 1087 bytes} [Sat Oct 29 20:31:59 2022] GET /identity/v3/services => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 20:31:59.990699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ffecd-4c68-46e5-a061-b1ed81563562 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:00.091382 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ffecd-4c68-46e5-a061-b1ed81563562 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:00.116604 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:00.126106 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8e1ae-6869-4e41-9a00-c1c6bee74766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:00.126732 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e1ae-6869-4e41-9a00-c1c6bee74766 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:00.127007 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e1ae-6869-4e41-9a00-c1c6bee74766 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:00.127274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e1ae-6869-4e41-9a00-c1c6bee74766 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:00.127900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8e1ae-6869-4e41-9a00-c1c6bee74766 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:00.129291 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8e1ae-6869-4e41-9a00-c1c6bee74766 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-a9b8e1ae-6869-4e41-9a00-c1c6bee74766 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:32:00.138047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:32:00.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:32:00.140050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 293/598] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:31:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:32:00.145848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081c427-bcc4-4559-b4da-a607842ddba3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:00.179109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:00.247021 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081c427-bcc4-4559-b4da-a607842ddba3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:00.283199 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d14071-73ee-48f6-90ed-2988e19856be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:00.283834 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d14071-73ee-48f6-90ed-2988e19856be None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:00.284108 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d14071-73ee-48f6-90ed-2988e19856be None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:00.284375 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d14071-73ee-48f6-90ed-2988e19856be None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:00.284994 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d14071-73ee-48f6-90ed-2988e19856be None admin] RBAC: Adding query filter params (name=compute) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:32:00.285292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d14071-73ee-48f6-90ed-2988e19856be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:00.286659 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d14071-73ee-48f6-90ed-2988e19856be None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:00.291308 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 306/599] 10.222.0.40 () {56 vars in 1112 bytes} [Sat Oct 29 20:32:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:32:00.297960 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8e1ae-6869-4e41-9a00-c1c6bee74766 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:00.396019 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8e1ae-6869-4e41-9a00-c1c6bee74766 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:00.428885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4326c5-22b9-414f-9126-127a9e2715fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:00.429482 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4326c5-22b9-414f-9126-127a9e2715fc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:00.429761 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4326c5-22b9-414f-9126-127a9e2715fc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:00.430034 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4326c5-22b9-414f-9126-127a9e2715fc None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:00.430657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4326c5-22b9-414f-9126-127a9e2715fc None admin] RBAC: Adding query filter params (type=compute) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:32:00.430956 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4326c5-22b9-414f-9126-127a9e2715fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:00.432350 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4326c5-22b9-414f-9126-127a9e2715fc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:00.436664 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 294/600] 10.222.0.40 () {56 vars in 1112 bytes} [Sat Oct 29 20:32:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:32:02.145776 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b376f-3991-47ac-ad7b-ab7f903326f9 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:02.146308 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b376f-3991-47ac-ad7b-ab7f903326f9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:02.146308 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b376f-3991-47ac-ad7b-ab7f903326f9 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:02.147763 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 307/601] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:32:02.152898 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3782106-9f89-4678-a1ec-36cecbaccdd2 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:02.153303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3782106-9f89-4678-a1ec-36cecbaccdd2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:02.153443 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3782106-9f89-4678-a1ec-36cecbaccdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:02.173468 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f3782106-9f89-4678-a1ec-36cecbaccdd2 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:32:02.174626 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f3782106-9f89-4678-a1ec-36cecbaccdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:32:02.224289 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:02.241776 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 295/602] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:32:02 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:32:02.570072 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b376f-3991-47ac-ad7b-ab7f903326f9 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:02.668704 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:02.675359 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b376f-3991-47ac-ad7b-ab7f903326f9 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:02.712497 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d77c3-cb5b-4622-aff0-8e1ebc0d2a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:02.713123 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d77c3-cb5b-4622-aff0-8e1ebc0d2a35 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:02.713392 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d77c3-cb5b-4622-aff0-8e1ebc0d2a35 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:02.713657 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d77c3-cb5b-4622-aff0-8e1ebc0d2a35 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:02.714226 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d77c3-cb5b-4622-aff0-8e1ebc0d2a35 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:02.715624 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d77c3-cb5b-4622-aff0-8e1ebc0d2a35 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-5e3d77c3-cb5b-4622-aff0-8e1ebc0d2a35 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:32:02.725508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:32:02.727485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:02.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 308/603] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:32:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:32:02.732646 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3782106-9f89-4678-a1ec-36cecbaccdd2 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:02.825807 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275820-cbf8-4c4e-b723-f6960a77b1ea None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:02.826019 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275820-cbf8-4c4e-b723-f6960a77b1ea None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:02.826294 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275820-cbf8-4c4e-b723-f6960a77b1ea None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:02.827738 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 309/604] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:32:02.833720 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38d27-2aeb-40ed-bf99-bd34e08f28db None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:02.834001 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38d27-2aeb-40ed-bf99-bd34e08f28db None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:02.834267 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38d27-2aeb-40ed-bf99-bd34e08f28db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:02.836735 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3782106-9f89-4678-a1ec-36cecbaccdd2 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:02.852308 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-41f38d27-2aeb-40ed-bf99-bd34e08f28db None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:32:02.853482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-41f38d27-2aeb-40ed-bf99-bd34e08f28db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:32:02.871149 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685172d-ff1c-4576-abd8-72338f5ff895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:02.871780 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685172d-ff1c-4576-abd8-72338f5ff895 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:02.872058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685172d-ff1c-4576-abd8-72338f5ff895 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:02.872328 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685172d-ff1c-4576-abd8-72338f5ff895 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:02.872958 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685172d-ff1c-4576-abd8-72338f5ff895 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:32:02.873255 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685172d-ff1c-4576-abd8-72338f5ff895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:02.874622 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685172d-ff1c-4576-abd8-72338f5ff895 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:02.879412 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 296/605] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:32:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:32:02.884954 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685172d-ff1c-4576-abd8-72338f5ff895 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:02.920110 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 310/606] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:32:02 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 20:32:02.934373 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:02.984987 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685172d-ff1c-4576-abd8-72338f5ff895 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:03.018506 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cf925-333c-4934-82ff-b1dddc6e6a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:03.019098 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cf925-333c-4934-82ff-b1dddc6e6a3a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:03.019401 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cf925-333c-4934-82ff-b1dddc6e6a3a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:03.019673 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cf925-333c-4934-82ff-b1dddc6e6a3a None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:03.020292 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cf925-333c-4934-82ff-b1dddc6e6a3a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:32:03.020590 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cf925-333c-4934-82ff-b1dddc6e6a3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:03.021941 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cf925-333c-4934-82ff-b1dddc6e6a3a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:03.026517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 297/607] 10.222.0.40 () {56 vars in 1114 bytes} [Sat Oct 29 20:32:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:32:03.032498 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38d27-2aeb-40ed-bf99-bd34e08f28db None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:03.122482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:03.131684 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38d27-2aeb-40ed-bf99-bd34e08f28db None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:03.165487 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fa8cc-9a15-4e5e-acee-4ad2fea4e3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:03.166118 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fa8cc-9a15-4e5e-acee-4ad2fea4e3b6 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:03.166396 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fa8cc-9a15-4e5e-acee-4ad2fea4e3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:03.166669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fa8cc-9a15-4e5e-acee-4ad2fea4e3b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:03.167353 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fa8cc-9a15-4e5e-acee-4ad2fea4e3b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:03.168722 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fa8cc-9a15-4e5e-acee-4ad2fea4e3b6 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:03.188803 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 311/608] 10.222.0.40 () {60 vars in 1144 bytes} [Sat Oct 29 20:32:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:32:03.248976 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cf925-333c-4934-82ff-b1dddc6e6a3a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:03.362113 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cf925-333c-4934-82ff-b1dddc6e6a3a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:03.376984 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:03.404362 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac72258-59f4-4470-9b86-c623b085fd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:03.404970 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac72258-59f4-4470-9b86-c623b085fd6d None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:03.405238 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac72258-59f4-4470-9b86-c623b085fd6d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:03.405502 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac72258-59f4-4470-9b86-c623b085fd6d None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:03.406737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac72258-59f4-4470-9b86-c623b085fd6d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:03.408632 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac72258-59f4-4470-9b86-c623b085fd6d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:03.425497 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 298/609] 10.222.0.40 () {60 vars in 1141 bytes} [Sat Oct 29 20:32:03 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:32:05.624351 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9124-1e8f-4ea7-94fe-8cb09dd1ee62 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:05.624918 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9124-1e8f-4ea7-94fe-8cb09dd1ee62 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:05.624918 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9124-1e8f-4ea7-94fe-8cb09dd1ee62 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:05.626226 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 312/610] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:32:05.631704 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e11122-b4a6-4ff1-b26a-882d43d11daa None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:05.632108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e11122-b4a6-4ff1-b26a-882d43d11daa None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:05.632234 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e11122-b4a6-4ff1-b26a-882d43d11daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:05.650532 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-10e11122-b4a6-4ff1-b26a-882d43d11daa None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:32:05.651724 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-10e11122-b4a6-4ff1-b26a-882d43d11daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:32:05.722392 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 299/611] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:32:05 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:32:05.836360 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89548b32-498c-4f23-8588-735c55647e31 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:05.836647 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89548b32-498c-4f23-8588-735c55647e31 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:05.836911 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89548b32-498c-4f23-8588-735c55647e31 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:05.838243 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 313/612] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:32:05.843442 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04eac-852d-4e7a-ae54-aa0a5eee1dc3 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:05.844877 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04eac-852d-4e7a-ae54-aa0a5eee1dc3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:05.845160 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04eac-852d-4e7a-ae54-aa0a5eee1dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:05.864020 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-90a04eac-852d-4e7a-ae54-aa0a5eee1dc3 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:32:05.865182 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-90a04eac-852d-4e7a-ae54-aa0a5eee1dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:32:05.932481 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 300/613] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:32:05 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:32:06.048261 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89548b32-498c-4f23-8588-735c55647e31 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:06.148386 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89548b32-498c-4f23-8588-735c55647e31 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:06.181929 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8739899-1126-4c3f-ae7b-a234fe049f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:06.182572 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8739899-1126-4c3f-ae7b-a234fe049f92 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:06.182803 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8739899-1126-4c3f-ae7b-a234fe049f92 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:06.183077 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8739899-1126-4c3f-ae7b-a234fe049f92 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:06.183744 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8739899-1126-4c3f-ae7b-a234fe049f92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:06.185184 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8739899-1126-4c3f-ae7b-a234fe049f92 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:06.187816 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: WARNING keystone.server.flask.common [None req-a8739899-1126-4c3f-ae7b-a234fe049f92 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 29 20:32:06.205972 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.sql.core [None req-a8739899-1126-4c3f-ae7b-a234fe049f92 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 29 20:32:06.205972 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 20:32:06.205972 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [parameters: {'id': '69018483882c4331943264785b3a9560', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 29 20:32:06.205972 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88418) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 20:32:06.222364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-a8739899-1126-4c3f-ae7b-a234fe049f92 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 69018483882c4331943264785b3a9560.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 69018483882c4331943264785b3a9560. Oct 29 20:32:06.222364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:06.222364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 20:32:06.222364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 20:32:06.222364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 20:32:06.222364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 20:32:06.222364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 20:32:06.222364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 20:32:06.222364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 20:32:06.222364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application conn.query(q) Oct 29 20:32:06.222364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 20:32:06.222364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 20:32:06.222364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application result.read() Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 29 20:32:06.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application next(self.gen) Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application yield resource Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application next(self.gen) Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.session.rollback() Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.force_reraise() Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise self.value Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application session.commit() Oct 29 20:32:06.224588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._prepare_impl() Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.session.flush() Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._flush(objects) Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application compat.raise_( Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application flush_context.execute() Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 20:32:06.225665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rec.execute(self) Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 29 20:32:06.226817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application conn.query(q) Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application result.read() Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 20:32:06.227833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [parameters: {'id': '69018483882c4331943264785b3a9560', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:06.229264 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:32:06.232300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:32:06.233389 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:32:06.233389 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 29 20:32:06.233389 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 29 20:32:06.233389 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:32:06.233389 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:32:06.233389 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 29 20:32:06.233389 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 29 20:32:06.233389 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 69018483882c4331943264785b3a9560. Oct 29 20:32:06.233389 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:06.233972 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a04eac-852d-4e7a-ae54-aa0a5eee1dc3 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:06.234056 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 314/614] 10.222.0.40 () {60 vars in 1140 bytes} [Sat Oct 29 20:32:06 2022] POST /identity/v3/projects => generated 262 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:32:06.259799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:06.262152 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8739899-1126-4c3f-ae7b-a234fe049f92 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:06.269369 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:06.335875 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a04eac-852d-4e7a-ae54-aa0a5eee1dc3 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:06.366420 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8739899-1126-4c3f-ae7b-a234fe049f92 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:06.370334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4e7aa-eee4-41df-aa55-e00ad8c5c3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:06.370955 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4e7aa-eee4-41df-aa55-e00ad8c5c3c2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:06.371232 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4e7aa-eee4-41df-aa55-e00ad8c5c3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:06.371528 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4e7aa-eee4-41df-aa55-e00ad8c5c3c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:06.378832 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4e7aa-eee4-41df-aa55-e00ad8c5c3c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:06.380301 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4e7aa-eee4-41df-aa55-e00ad8c5c3c2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-3de4e7aa-eee4-41df-aa55-e00ad8c5c3c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:32:06.391321 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:32:06.392303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:32:06.393175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:32:06.393175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:32:06.393175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:32:06.393175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:32:06.393175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:32:06.393175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:32:06.393175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:32:06.393175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:32:06.393175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 301/615] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:32:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:32:06.398259 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4e7aa-eee4-41df-aa55-e00ad8c5c3c2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:06.403176 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a4317-63b1-49d2-a2b7-5822322e8e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:06.403836 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a4317-63b1-49d2-a2b7-5822322e8e51 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:06.404116 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a4317-63b1-49d2-a2b7-5822322e8e51 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:06.404387 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a4317-63b1-49d2-a2b7-5822322e8e51 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:06.404967 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a4317-63b1-49d2-a2b7-5822322e8e51 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:06.406597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a4317-63b1-49d2-a2b7-5822322e8e51 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-c38a4317-63b1-49d2-a2b7-5822322e8e51 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:32:06.415364 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:32:06.416609 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:06.417619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 315/616] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:32:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:32:06.422921 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a4317-63b1-49d2-a2b7-5822322e8e51 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:06.487646 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:06.492013 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:06.505366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4e7aa-eee4-41df-aa55-e00ad8c5c3c2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:06.525885 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a4317-63b1-49d2-a2b7-5822322e8e51 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:06.538564 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9316bad-3ab7-4347-beb9-3f472ba1a4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:06.539277 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9316bad-3ab7-4347-beb9-3f472ba1a4bc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:06.539646 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9316bad-3ab7-4347-beb9-3f472ba1a4bc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:06.539919 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9316bad-3ab7-4347-beb9-3f472ba1a4bc None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:06.540580 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9316bad-3ab7-4347-beb9-3f472ba1a4bc None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:32:06.540878 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9316bad-3ab7-4347-beb9-3f472ba1a4bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:06.542313 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9316bad-3ab7-4347-beb9-3f472ba1a4bc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:06.559750 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 302/617] 10.222.0.40 () {56 vars in 1112 bytes} [Sat Oct 29 20:32:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:32:06.560169 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d631714-09e9-4ba7-87a5-8632c4937c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:06.560802 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d631714-09e9-4ba7-87a5-8632c4937c06 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:06.561074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d631714-09e9-4ba7-87a5-8632c4937c06 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:06.561338 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d631714-09e9-4ba7-87a5-8632c4937c06 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:06.561957 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d631714-09e9-4ba7-87a5-8632c4937c06 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:32:06.562259 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d631714-09e9-4ba7-87a5-8632c4937c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:06.564701 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d631714-09e9-4ba7-87a5-8632c4937c06 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:06.573112 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 316/618] 10.222.0.40 () {56 vars in 1112 bytes} [Sat Oct 29 20:32:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:32:06.579155 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9316bad-3ab7-4347-beb9-3f472ba1a4bc None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:06.684453 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9316bad-3ab7-4347-beb9-3f472ba1a4bc None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:06.725349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ea32a-06bb-4d02-ae8e-3878671af2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:06.725968 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ea32a-06bb-4d02-ae8e-3878671af2e1 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:06.726241 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ea32a-06bb-4d02-ae8e-3878671af2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:06.726507 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ea32a-06bb-4d02-ae8e-3878671af2e1 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:06.727142 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ea32a-06bb-4d02-ae8e-3878671af2e1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:32:06.727476 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ea32a-06bb-4d02-ae8e-3878671af2e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:06.728848 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ea32a-06bb-4d02-ae8e-3878671af2e1 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:06.734341 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 303/619] 10.222.0.40 () {56 vars in 1112 bytes} [Sat Oct 29 20:32:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:32:06.741156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d631714-09e9-4ba7-87a5-8632c4937c06 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:06.845222 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d631714-09e9-4ba7-87a5-8632c4937c06 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:06.879702 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:06.885255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b46c79-4a93-4eef-8efc-32d606ea6b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:06.885985 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46c79-4a93-4eef-8efc-32d606ea6b3a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:06.886372 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46c79-4a93-4eef-8efc-32d606ea6b3a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:06.886752 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46c79-4a93-4eef-8efc-32d606ea6b3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:06.887603 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b46c79-4a93-4eef-8efc-32d606ea6b3a None admin] RBAC: Adding query filter params (interface=public, service_id=59c895ede76c47b091b2e7ee22c0e02f, region_id=RegionOne) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:32:06.888027 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b46c79-4a93-4eef-8efc-32d606ea6b3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:06.889518 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b46c79-4a93-4eef-8efc-32d606ea6b3a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:06.894788 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 317/620] 10.222.0.40 () {56 vars in 1251 bytes} [Sat Oct 29 20:32:06 2022] GET /identity/v3/endpoints?service_id=59c895ede76c47b091b2e7ee22c0e02f&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:32:06.900525 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ea32a-06bb-4d02-ae8e-3878671af2e1 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:06.912085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:07.001558 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ea32a-06bb-4d02-ae8e-3878671af2e1 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:07.034573 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9e18b-ce20-4159-8618-d698925f5704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:07.035169 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9e18b-ce20-4159-8618-d698925f5704 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:07.035482 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9e18b-ce20-4159-8618-d698925f5704 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:07.035753 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9e18b-ce20-4159-8618-d698925f5704 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:07.036350 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9e18b-ce20-4159-8618-d698925f5704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:07.037712 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9e18b-ce20-4159-8618-d698925f5704 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:07.043888 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 304/621] 10.222.0.40 () {56 vars in 1087 bytes} [Sat Oct 29 20:32:06 2022] GET /identity/v3/services => generated 1728 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 20:32:09.010517 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d38b7a-76c8-47f0-a708-c3e9cb833cce None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:09.011129 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d38b7a-76c8-47f0-a708-c3e9cb833cce None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:09.011129 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d38b7a-76c8-47f0-a708-c3e9cb833cce None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:09.012446 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 318/622] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:32:09.018014 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc074d-02ea-4798-bf62-c21622fb92cc None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:09.018449 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc074d-02ea-4798-bf62-c21622fb92cc None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:09.018673 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc074d-02ea-4798-bf62-c21622fb92cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:09.037836 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c3bc074d-02ea-4798-bf62-c21622fb92cc None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:32:09.039025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c3bc074d-02ea-4798-bf62-c21622fb92cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:32:09.110381 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 305/623] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:32:09 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:32:09.434186 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d38b7a-76c8-47f0-a708-c3e9cb833cce None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:09.474603 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459201a6-c478-4afb-8105-1d69edf6c68d None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:09.474884 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459201a6-c478-4afb-8105-1d69edf6c68d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:09.475161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459201a6-c478-4afb-8105-1d69edf6c68d None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:09.476555 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 306/624] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:32:09.481501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fcc82-6739-45de-81c1-fa452fd19287 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:09.482010 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fcc82-6739-45de-81c1-fa452fd19287 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:09.482286 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fcc82-6739-45de-81c1-fa452fd19287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:09.489642 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:09.501674 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-1a3fcc82-6739-45de-81c1-fa452fd19287 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:32:09.502855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1a3fcc82-6739-45de-81c1-fa452fd19287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:32:09.537555 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d38b7a-76c8-47f0-a708-c3e9cb833cce None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:09.568753 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 307/625] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:32:09 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 20:32:09.574690 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efab1f-4e4e-4467-8e24-2a0b26183096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:09.575292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efab1f-4e4e-4467-8e24-2a0b26183096 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:09.575600 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efab1f-4e4e-4467-8e24-2a0b26183096 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:09.575874 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efab1f-4e4e-4467-8e24-2a0b26183096 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:09.576517 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efab1f-4e4e-4467-8e24-2a0b26183096 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:09.578461 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efab1f-4e4e-4467-8e24-2a0b26183096 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:09.593481 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.sql.core [None req-23efab1f-4e4e-4467-8e24-2a0b26183096 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 29 20:32:09.593481 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 29 20:32:09.593481 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [parameters: {'user_id': 'f6ed5785bec6470fb530cd0f39bbc4b2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 29 20:32:09.593481 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88418) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-23efab1f-4e4e-4467-8e24-2a0b26183096 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application conn.query(q) Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application result.read() Oct 29 20:32:09.601134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 20:32:09.602217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application next(self.gen) Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application yield resource Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application next(self.gen) Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.session.rollback() Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.force_reraise() Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise self.value Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application session.commit() Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 29 20:32:09.603597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._prepare_impl() Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.session.flush() Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._flush(objects) Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application compat.raise_( Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application flush_context.execute() Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rec.execute(self) Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 20:32:09.604831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 20:32:09.606030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application conn.query(q) Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application result.read() Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 20:32:09.607394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f6ed5785bec6470fb530cd0f39bbc4b2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:32:09.608491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 29 20:32:09.609533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 29 20:32:09.610677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 29 20:32:09.610677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 29 20:32:09.610677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 29 20:32:09.610677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 29 20:32:09.610677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 29 20:32:09.610677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:32:09.610677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 319/626] 10.222.0.40 () {60 vars in 1131 bytes} [Sat Oct 29 20:32:09 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:32:09.612244 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fcc82-6739-45de-81c1-fa452fd19287 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:09.709790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fcc82-6739-45de-81c1-fa452fd19287 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:09.737639 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:09.742761 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b086360-2cad-4d2c-9443-cf76478dc62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:09.743403 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b086360-2cad-4d2c-9443-cf76478dc62e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:09.743678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b086360-2cad-4d2c-9443-cf76478dc62e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:09.743944 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b086360-2cad-4d2c-9443-cf76478dc62e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:09.751324 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b086360-2cad-4d2c-9443-cf76478dc62e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:09.752756 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b086360-2cad-4d2c-9443-cf76478dc62e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-1b086360-2cad-4d2c-9443-cf76478dc62e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:32:09.764799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:32:09.766406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:32:09.767448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:32:09.767448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:32:09.767448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:32:09.767448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:32:09.767448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:32:09.767448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:32:09.767448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:32:09.767448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:32:09.767448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 20:32:09.767448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:32:09.767448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 308/627] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:32:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:32:09.772426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efab1f-4e4e-4467-8e24-2a0b26183096 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:09.832190 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:09.873549 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efab1f-4e4e-4467-8e24-2a0b26183096 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:09.901907 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b086360-2cad-4d2c-9443-cf76478dc62e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:09.910526 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da7c6c-4558-4fb8-a3e0-5ea72cb2c65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:09.911132 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da7c6c-4558-4fb8-a3e0-5ea72cb2c65e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:09.911453 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da7c6c-4558-4fb8-a3e0-5ea72cb2c65e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:09.911724 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da7c6c-4558-4fb8-a3e0-5ea72cb2c65e None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:09.912417 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da7c6c-4558-4fb8-a3e0-5ea72cb2c65e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:32:09.912716 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da7c6c-4558-4fb8-a3e0-5ea72cb2c65e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:09.914349 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da7c6c-4558-4fb8-a3e0-5ea72cb2c65e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:09.952409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 320/628] 10.222.0.40 () {56 vars in 1101 bytes} [Sat Oct 29 20:32:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:32:10.005839 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b086360-2cad-4d2c-9443-cf76478dc62e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:10.042211 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e816944-efb6-4e70-834b-dd662ecbad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:10.042909 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e816944-efb6-4e70-834b-dd662ecbad1a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:10.043109 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e816944-efb6-4e70-834b-dd662ecbad1a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:10.043411 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e816944-efb6-4e70-834b-dd662ecbad1a None admin] PATH_INFO: `/v3/services/compute` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:10.044001 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e816944-efb6-4e70-834b-dd662ecbad1a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:10.045404 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e816944-efb6-4e70-834b-dd662ecbad1a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-5e816944-efb6-4e70-834b-dd662ecbad1a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:32:10.055688 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:32:10.056821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:32:10.057657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 309/629] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:32:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:32:10.063328 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da7c6c-4558-4fb8-a3e0-5ea72cb2c65e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:10.170162 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da7c6c-4558-4fb8-a3e0-5ea72cb2c65e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:10.189618 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:10.208529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172ba1b-aed2-45da-b8d1-c56ef9a9da6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:10.209137 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172ba1b-aed2-45da-b8d1-c56ef9a9da6d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:10.209414 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172ba1b-aed2-45da-b8d1-c56ef9a9da6d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:10.209682 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172ba1b-aed2-45da-b8d1-c56ef9a9da6d None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:10.210308 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172ba1b-aed2-45da-b8d1-c56ef9a9da6d None admin] RBAC: Adding query filter params (name=compute) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:32:10.210604 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172ba1b-aed2-45da-b8d1-c56ef9a9da6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:10.212011 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172ba1b-aed2-45da-b8d1-c56ef9a9da6d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:10.216860 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 321/630] 10.222.0.40 () {56 vars in 1112 bytes} [Sat Oct 29 20:32:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:32:10.223388 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e816944-efb6-4e70-834b-dd662ecbad1a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:10.283512 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:10.324824 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e816944-efb6-4e70-834b-dd662ecbad1a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:10.358478 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055a310-f5d7-482f-a72a-c831724331a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:10.359083 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a310-f5d7-482f-a72a-c831724331a9 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:10.360331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a310-f5d7-482f-a72a-c831724331a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:10.360603 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a310-f5d7-482f-a72a-c831724331a9 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:10.361222 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055a310-f5d7-482f-a72a-c831724331a9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:32:10.361516 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055a310-f5d7-482f-a72a-c831724331a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:10.362860 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055a310-f5d7-482f-a72a-c831724331a9 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:10.367422 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 310/631] 10.222.0.40 () {56 vars in 1112 bytes} [Sat Oct 29 20:32:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:32:10.373307 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172ba1b-aed2-45da-b8d1-c56ef9a9da6d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:32:10.471889 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172ba1b-aed2-45da-b8d1-c56ef9a9da6d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:32:10.504882 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5c012-a2b5-464a-9c89-54b8dce0f79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:32:10.505477 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5c012-a2b5-464a-9c89-54b8dce0f79b None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:32:10.505753 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5c012-a2b5-464a-9c89-54b8dce0f79b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:32:10.506021 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5c012-a2b5-464a-9c89-54b8dce0f79b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:32:10.506681 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5c012-a2b5-464a-9c89-54b8dce0f79b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:32:10.508142 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5c012-a2b5-464a-9c89-54b8dce0f79b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:32:10.527167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 322/632] 10.222.0.40 () {60 vars in 1144 bytes} [Sat Oct 29 20:32:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:32:20.365125 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=40 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:32:20.522898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=81,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:13.884609 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bd0ff-0456-4a1d-b060-3c508845e791 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:13.885188 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bd0ff-0456-4a1d-b060-3c508845e791 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:13.885188 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bd0ff-0456-4a1d-b060-3c508845e791 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:13.886720 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 311/633] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:33:13.892586 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62d3ac-7b35-4a16-a9d8-db8c9653dc36 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:13.893064 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62d3ac-7b35-4a16-a9d8-db8c9653dc36 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:13.893161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62d3ac-7b35-4a16-a9d8-db8c9653dc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:13.912384 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ae62d3ac-7b35-4a16-a9d8-db8c9653dc36 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:33:13.913952 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ae62d3ac-7b35-4a16-a9d8-db8c9653dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:33:14.003563 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 323/634] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:33:13 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:33:14.361786 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bd0ff-0456-4a1d-b060-3c508845e791 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:14.519946 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bd0ff-0456-4a1d-b060-3c508845e791 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:14.574901 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc3cb5-b1a3-4cb1-8b82-5213f8cb1ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:14.575595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc3cb5-b1a3-4cb1-8b82-5213f8cb1ed9 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:14.575928 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc3cb5-b1a3-4cb1-8b82-5213f8cb1ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:14.576307 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc3cb5-b1a3-4cb1-8b82-5213f8cb1ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:14.590554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc3cb5-b1a3-4cb1-8b82-5213f8cb1ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:14.592146 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc3cb5-b1a3-4cb1-8b82-5213f8cb1ed9 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-87bc3cb5-b1a3-4cb1-8b82-5213f8cb1ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:33:14.614108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:14.615517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:33:14.616599 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:33:14.616599 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:14.616599 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:33:14.616599 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 312/635] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:14.623354 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62d3ac-7b35-4a16-a9d8-db8c9653dc36 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:14.742182 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62d3ac-7b35-4a16-a9d8-db8c9653dc36 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:14.778045 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:14.786538 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a9c02-8664-4e69-8ef4-50eb190d7096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:14.787323 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a9c02-8664-4e69-8ef4-50eb190d7096 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:14.788786 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a9c02-8664-4e69-8ef4-50eb190d7096 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:14.788786 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a9c02-8664-4e69-8ef4-50eb190d7096 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:14.789001 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a9c02-8664-4e69-8ef4-50eb190d7096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:14.789226 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a9c02-8664-4e69-8ef4-50eb190d7096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:14.790697 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a9c02-8664-4e69-8ef4-50eb190d7096 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:14.810919 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 324/636] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:14.817033 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc3cb5-b1a3-4cb1-8b82-5213f8cb1ed9 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:14.886379 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:14.943780 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc3cb5-b1a3-4cb1-8b82-5213f8cb1ed9 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:14.983885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c132560-d079-4849-b55c-f51b74fcdbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:14.984484 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132560-d079-4849-b55c-f51b74fcdbfc None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:14.984761 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132560-d079-4849-b55c-f51b74fcdbfc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:14.985029 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132560-d079-4849-b55c-f51b74fcdbfc None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:14.985676 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c132560-d079-4849-b55c-f51b74fcdbfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:14.987128 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c132560-d079-4849-b55c-f51b74fcdbfc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:15.009737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 313/637] 10.222.0.40 () {60 vars in 1132 bytes} [Sat Oct 29 20:33:14 2022] POST /identity/v3/users => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:33:17.742035 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5b738-d5ba-4f82-964c-c029948a42da None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:17.742567 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5b738-d5ba-4f82-964c-c029948a42da None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:17.742567 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5b738-d5ba-4f82-964c-c029948a42da None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:17.743924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 325/638] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:33:17.750388 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60f60c-4a2b-4ba9-a8da-ee00c4371b49 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:17.751748 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60f60c-4a2b-4ba9-a8da-ee00c4371b49 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:17.751748 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60f60c-4a2b-4ba9-a8da-ee00c4371b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:17.770418 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-8e60f60c-4a2b-4ba9-a8da-ee00c4371b49 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:33:17.771622 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8e60f60c-4a2b-4ba9-a8da-ee00c4371b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:33:17.855366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 314/639] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:33:17 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:33:18.221150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5b738-d5ba-4f82-964c-c029948a42da None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:18.340278 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5b738-d5ba-4f82-964c-c029948a42da None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:18.376372 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7ca70-8881-42a7-8839-1298b324c4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:18.376998 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7ca70-8881-42a7-8839-1298b324c4b7 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:18.377273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7ca70-8881-42a7-8839-1298b324c4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:18.377541 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7ca70-8881-42a7-8839-1298b324c4b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:18.389783 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7ca70-8881-42a7-8839-1298b324c4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-1be7ca70-8881-42a7-8839-1298b324c4b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:33:18.395553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:18.396808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:18.397824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:18.397824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:18.397824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:18.397824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:18.397824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:33:18.397824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:33:18.397824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:33:18.397824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:33:18.397824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:33:18.397824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:33:18.397824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:33:18.397824 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:18.401897 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 326/640] 10.222.0.40 () {56 vars in 1102 bytes} [Sat Oct 29 20:33:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:18.403203 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60f60c-4a2b-4ba9-a8da-ee00c4371b49 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:18.448453 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:18.516000 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60f60c-4a2b-4ba9-a8da-ee00c4371b49 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:18.553451 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee404d84-6cd7-4304-8603-8f79c634a69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:18.554051 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee404d84-6cd7-4304-8603-8f79c634a69d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:18.554327 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee404d84-6cd7-4304-8603-8f79c634a69d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:18.554598 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee404d84-6cd7-4304-8603-8f79c634a69d None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:18.555263 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee404d84-6cd7-4304-8603-8f79c634a69d None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:18.555603 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee404d84-6cd7-4304-8603-8f79c634a69d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:18.557015 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee404d84-6cd7-4304-8603-8f79c634a69d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:18.565166 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 315/641] 10.222.0.40 () {56 vars in 1103 bytes} [Sat Oct 29 20:33:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:33:18.570992 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7ca70-8881-42a7-8839-1298b324c4b7 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:18.630515 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:18.692420 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7ca70-8881-42a7-8839-1298b324c4b7 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:18.735246 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d442e-fa56-4eb6-9c1b-8abf888064e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:18.736143 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d442e-fa56-4eb6-9c1b-8abf888064e4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:18.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d442e-fa56-4eb6-9c1b-8abf888064e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:18.736868 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d442e-fa56-4eb6-9c1b-8abf888064e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:18.749109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d442e-fa56-4eb6-9c1b-8abf888064e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:18.751050 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d442e-fa56-4eb6-9c1b-8abf888064e4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-e77d442e-fa56-4eb6-9c1b-8abf888064e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:33:18.768440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:18.769612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:33:18.770643 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:33:18.770643 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:18.770643 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:18.770643 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 327/642] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:18.776839 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee404d84-6cd7-4304-8603-8f79c634a69d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:18.897629 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:18.901222 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee404d84-6cd7-4304-8603-8f79c634a69d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:18.940984 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf610e3-fe5e-4807-a184-a7e0edc3949a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:18.941578 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf610e3-fe5e-4807-a184-a7e0edc3949a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:18.941878 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf610e3-fe5e-4807-a184-a7e0edc3949a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:18.942128 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf610e3-fe5e-4807-a184-a7e0edc3949a None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:18.942777 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf610e3-fe5e-4807-a184-a7e0edc3949a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:18.943086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf610e3-fe5e-4807-a184-a7e0edc3949a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:18.944498 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf610e3-fe5e-4807-a184-a7e0edc3949a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:18.956765 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 316/643] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:18.962951 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d442e-fa56-4eb6-9c1b-8abf888064e4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:19.081540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:19.086032 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d442e-fa56-4eb6-9c1b-8abf888064e4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:19.124373 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f726a-7de8-492a-998d-ee8be22c4cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:19.125051 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f726a-7de8-492a-998d-ee8be22c4cbc None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:19.125343 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f726a-7de8-492a-998d-ee8be22c4cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:19.125629 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f726a-7de8-492a-998d-ee8be22c4cbc None admin] PATH_INFO: `/v3/users/placement` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:19.133879 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f726a-7de8-492a-998d-ee8be22c4cbc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:19.135443 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f726a-7de8-492a-998d-ee8be22c4cbc None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-1d0f726a-7de8-492a-998d-ee8be22c4cbc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:33:19.147591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:19.148819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:19.152273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:19.152273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:19.152273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:33:19.152273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:33:19.152273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:33:19.152273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:33:19.152273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:33:19.152273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:33:19.152273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 29 20:33:19.152273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:19.152273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 328/644] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:33:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:19.155272 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf610e3-fe5e-4807-a184-a7e0edc3949a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:19.270484 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf610e3-fe5e-4807-a184-a7e0edc3949a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:19.307522 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5f522-d99a-4a27-aaf0-05cb5515cdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:19.308182 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5f522-d99a-4a27-aaf0-05cb5515cdf7 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:19.308434 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5f522-d99a-4a27-aaf0-05cb5515cdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:19.308701 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5f522-d99a-4a27-aaf0-05cb5515cdf7 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:19.309526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5f522-d99a-4a27-aaf0-05cb5515cdf7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:19.309765 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5f522-d99a-4a27-aaf0-05cb5515cdf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:19.312560 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5f522-d99a-4a27-aaf0-05cb5515cdf7 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:19.331144 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 317/645] 10.222.0.40 () {56 vars in 1143 bytes} [Sat Oct 29 20:33:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:33:19.337051 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f726a-7de8-492a-998d-ee8be22c4cbc None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:19.439734 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f726a-7de8-492a-998d-ee8be22c4cbc None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:19.475751 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8215deb-9f83-47d4-9d0b-1e164656e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:19.476370 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8215deb-9f83-47d4-9d0b-1e164656e525 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:19.476694 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8215deb-9f83-47d4-9d0b-1e164656e525 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:19.476943 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8215deb-9f83-47d4-9d0b-1e164656e525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:19.487982 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8215deb-9f83-47d4-9d0b-1e164656e525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:19.489499 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8215deb-9f83-47d4-9d0b-1e164656e525 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-d8215deb-9f83-47d4-9d0b-1e164656e525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:33:19.505114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:19.506339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:33:19.507835 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:33:19.507835 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:19.507835 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:19.507835 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 329/646] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:19.511990 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5f522-d99a-4a27-aaf0-05cb5515cdf7 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:19.534839 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:19.620108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5f522-d99a-4a27-aaf0-05cb5515cdf7 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:19.656694 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f0624-6783-4434-9749-caab8ca8397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:19.657292 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f0624-6783-4434-9749-caab8ca8397f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:19.657563 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f0624-6783-4434-9749-caab8ca8397f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:19.657832 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f0624-6783-4434-9749-caab8ca8397f None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:19.658508 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f0624-6783-4434-9749-caab8ca8397f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:19.658799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f0624-6783-4434-9749-caab8ca8397f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:19.660174 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f0624-6783-4434-9749-caab8ca8397f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:19.674395 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 318/647] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:19.680272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8215deb-9f83-47d4-9d0b-1e164656e525 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:19.693386 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:19.791428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8215deb-9f83-47d4-9d0b-1e164656e525 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:19.831268 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae63b-e289-4216-b47d-e0ecbf0493ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:19.831920 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae63b-e289-4216-b47d-e0ecbf0493ec None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:19.832201 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae63b-e289-4216-b47d-e0ecbf0493ec None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:19.832501 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae63b-e289-4216-b47d-e0ecbf0493ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:19.839281 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae63b-e289-4216-b47d-e0ecbf0493ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:19.840811 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae63b-e289-4216-b47d-e0ecbf0493ec None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-7ecae63b-e289-4216-b47d-e0ecbf0493ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:33:19.852233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:19.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:19.854154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:33:19.854154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:33:19.854154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:33:19.854154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:33:19.854154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:33:19.854154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:33:19.854154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:33:19.854154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:19.854154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 330/648] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:33:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:19.860636 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f0624-6783-4434-9749-caab8ca8397f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:19.943605 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:19.969198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f0624-6783-4434-9749-caab8ca8397f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:20.008296 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6a525-c350-4a9c-9bc4-452c55da82dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:20.008951 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6a525-c350-4a9c-9bc4-452c55da82dc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:20.009232 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6a525-c350-4a9c-9bc4-452c55da82dc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:20.009542 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6a525-c350-4a9c-9bc4-452c55da82dc None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:20.010270 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6a525-c350-4a9c-9bc4-452c55da82dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:20.010620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6a525-c350-4a9c-9bc4-452c55da82dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:20.012215 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6a525-c350-4a9c-9bc4-452c55da82dc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:20.025189 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 319/649] 10.222.0.40 () {56 vars in 1148 bytes} [Sat Oct 29 20:33:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:33:20.032013 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae63b-e289-4216-b47d-e0ecbf0493ec None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:20.110745 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:20.149505 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae63b-e289-4216-b47d-e0ecbf0493ec None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:20.185902 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cf5a7-a675-4bc0-9165-2553118bbaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:20.187078 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cf5a7-a675-4bc0-9165-2553118bbaa0 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:20.187424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cf5a7-a675-4bc0-9165-2553118bbaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:20.187700 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cf5a7-a675-4bc0-9165-2553118bbaa0 None admin] PATH_INFO: `/v3/projects/38c8029f1fc24cd098d360f54c51451d/users/d70c0c1dd66244b68052c278d9b39dce/roles/116e2c35edcf4173a8d203637a4237e0` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:20.203508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cf5a7-a675-4bc0-9165-2553118bbaa0 None admin] RBAC: Authorizing `identity:create_grant(project_id=38c8029f1fc24cd098d360f54c51451d, user_id=d70c0c1dd66244b68052c278d9b39dce, role_id=116e2c35edcf4173a8d203637a4237e0)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:20.204924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cf5a7-a675-4bc0-9165-2553118bbaa0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:20.218183 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 331/650] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:33:20 2022] PUT /identity/v3/projects/38c8029f1fc24cd098d360f54c51451d/users/d70c0c1dd66244b68052c278d9b39dce/roles/116e2c35edcf4173a8d203637a4237e0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:33:22.980594 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b0a66-46bd-433d-976c-77e4d8b62c98 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:22.981123 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b0a66-46bd-433d-976c-77e4d8b62c98 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:22.981123 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b0a66-46bd-433d-976c-77e4d8b62c98 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:22.983033 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 320/651] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:33:22.989014 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b3dea-3f69-4d32-9e53-dded3d4ad11a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:22.989505 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b3dea-3f69-4d32-9e53-dded3d4ad11a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:22.989627 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b3dea-3f69-4d32-9e53-dded3d4ad11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:23.008640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-814b3dea-3f69-4d32-9e53-dded3d4ad11a None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:33:23.009815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-814b3dea-3f69-4d32-9e53-dded3d4ad11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:33:23.082386 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 332/652] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:33:22 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 20:33:23.450133 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b0a66-46bd-433d-976c-77e4d8b62c98 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:23.565378 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b0a66-46bd-433d-976c-77e4d8b62c98 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:23.602282 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8a823-26a2-4d32-8d3a-75fdfbbce4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:23.603011 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8a823-26a2-4d32-8d3a-75fdfbbce4b2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:23.603222 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8a823-26a2-4d32-8d3a-75fdfbbce4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:23.603564 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8a823-26a2-4d32-8d3a-75fdfbbce4b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:23.612737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:23.617763 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8a823-26a2-4d32-8d3a-75fdfbbce4b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-bcb8a823-26a2-4d32-8d3a-75fdfbbce4b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:33:23.622840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:23.623953 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:23.625368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:23.625368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:23.625368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:23.625368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:23.625368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:33:23.625368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:33:23.625368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:33:23.625368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:33:23.625368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:33:23.625368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:33:23.625368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 20:33:23.625368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:33:23.625368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 321/653] 10.222.0.40 () {56 vars in 1102 bytes} [Sat Oct 29 20:33:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:23.631152 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b3dea-3f69-4d32-9e53-dded3d4ad11a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:23.689014 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:23.746954 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b3dea-3f69-4d32-9e53-dded3d4ad11a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:23.782337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334313bf-7533-4e66-881a-5ed722c687f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:23.782936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334313bf-7533-4e66-881a-5ed722c687f3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:23.783170 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334313bf-7533-4e66-881a-5ed722c687f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:23.783480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334313bf-7533-4e66-881a-5ed722c687f3 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:23.784140 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334313bf-7533-4e66-881a-5ed722c687f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:23.784442 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334313bf-7533-4e66-881a-5ed722c687f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:23.785904 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334313bf-7533-4e66-881a-5ed722c687f3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:23.802121 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 333/654] 10.222.0.40 () {56 vars in 1103 bytes} [Sat Oct 29 20:33:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:23.808233 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8a823-26a2-4d32-8d3a-75fdfbbce4b2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:23.932660 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8a823-26a2-4d32-8d3a-75fdfbbce4b2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:23.970491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de561a-d31b-4d59-8c96-17b77d58bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:23.971107 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de561a-d31b-4d59-8c96-17b77d58bc1f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:23.971408 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de561a-d31b-4d59-8c96-17b77d58bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:23.971674 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de561a-d31b-4d59-8c96-17b77d58bc1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:23.982068 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de561a-d31b-4d59-8c96-17b77d58bc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:23.984022 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de561a-d31b-4d59-8c96-17b77d58bc1f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-00de561a-d31b-4d59-8c96-17b77d58bc1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:33:24.000173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:24.002043 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:33:24.003574 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:33:24.003574 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:24.003574 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:33:24.003574 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 322/655] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:24.007644 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334313bf-7533-4e66-881a-5ed722c687f3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:24.120191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334313bf-7533-4e66-881a-5ed722c687f3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:24.134604 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:24.159289 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50312a50-0e13-497f-8e40-eb53a7848f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:24.160101 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50312a50-0e13-497f-8e40-eb53a7848f57 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:24.160385 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50312a50-0e13-497f-8e40-eb53a7848f57 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:24.160655 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50312a50-0e13-497f-8e40-eb53a7848f57 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:24.161304 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50312a50-0e13-497f-8e40-eb53a7848f57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:24.161627 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50312a50-0e13-497f-8e40-eb53a7848f57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:24.163012 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50312a50-0e13-497f-8e40-eb53a7848f57 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:24.180787 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 334/656] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:24.182103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de561a-d31b-4d59-8c96-17b77d58bc1f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:24.238368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:24.291319 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de561a-d31b-4d59-8c96-17b77d58bc1f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:24.326952 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12e849-7330-4fda-81f4-a16975f85038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:24.327613 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12e849-7330-4fda-81f4-a16975f85038 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:24.327891 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12e849-7330-4fda-81f4-a16975f85038 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:24.328157 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12e849-7330-4fda-81f4-a16975f85038 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:24.336135 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12e849-7330-4fda-81f4-a16975f85038 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:24.337588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12e849-7330-4fda-81f4-a16975f85038 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-9d12e849-7330-4fda-81f4-a16975f85038 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:33:24.349569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:24.350620 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:24.351855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:24.351855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:24.351855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:33:24.351855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:33:24.351855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:33:24.351855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:33:24.351855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:33:24.351855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:33:24.351855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 29 20:33:24.351855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:33:24.351855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 323/657] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:33:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:24.356562 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50312a50-0e13-497f-8e40-eb53a7848f57 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:24.462061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50312a50-0e13-497f-8e40-eb53a7848f57 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:24.499477 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43419183-1b33-4656-92db-3860f7e1c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:24.500014 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43419183-1b33-4656-92db-3860f7e1c968 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:24.500289 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43419183-1b33-4656-92db-3860f7e1c968 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:24.500555 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43419183-1b33-4656-92db-3860f7e1c968 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:24.501272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43419183-1b33-4656-92db-3860f7e1c968 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:24.501573 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43419183-1b33-4656-92db-3860f7e1c968 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:24.503003 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43419183-1b33-4656-92db-3860f7e1c968 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:24.521894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 335/658] 10.222.0.40 () {56 vars in 1143 bytes} [Sat Oct 29 20:33:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:24.528168 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12e849-7330-4fda-81f4-a16975f85038 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:24.637600 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12e849-7330-4fda-81f4-a16975f85038 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:24.648799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:24.674077 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d0b8f-03b7-49f0-98bd-8943f357c906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:24.674785 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d0b8f-03b7-49f0-98bd-8943f357c906 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:24.675068 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d0b8f-03b7-49f0-98bd-8943f357c906 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:24.675375 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d0b8f-03b7-49f0-98bd-8943f357c906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:24.745041 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d0b8f-03b7-49f0-98bd-8943f357c906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:24.746514 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d0b8f-03b7-49f0-98bd-8943f357c906 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:24.856997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 324/659] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:33:24 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 29 20:33:24.863694 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43419183-1b33-4656-92db-3860f7e1c968 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:24.895752 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:24.973161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43419183-1b33-4656-92db-3860f7e1c968 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:25.015156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800bc14-f63c-441e-97df-cdcd344db249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:25.015933 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800bc14-f63c-441e-97df-cdcd344db249 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:25.016191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800bc14-f63c-441e-97df-cdcd344db249 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:25.016462 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800bc14-f63c-441e-97df-cdcd344db249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:25.026839 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800bc14-f63c-441e-97df-cdcd344db249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:25.028317 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800bc14-f63c-441e-97df-cdcd344db249 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-1800bc14-f63c-441e-97df-cdcd344db249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:33:25.043542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:25.044815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:33:25.045773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:33:25.045773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:25.045773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:25.045773 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 336/660] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:25.052091 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d0b8f-03b7-49f0-98bd-8943f357c906 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:25.064112 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:25.163403 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d0b8f-03b7-49f0-98bd-8943f357c906 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:25.202725 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0afc79-b609-42a7-8b92-61894c03f64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:25.203401 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afc79-b609-42a7-8b92-61894c03f64c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:25.203730 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afc79-b609-42a7-8b92-61894c03f64c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:25.204000 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afc79-b609-42a7-8b92-61894c03f64c None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:25.204680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0afc79-b609-42a7-8b92-61894c03f64c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:25.205000 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0afc79-b609-42a7-8b92-61894c03f64c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:25.206597 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0afc79-b609-42a7-8b92-61894c03f64c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:25.219362 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 325/661] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:25.225223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800bc14-f63c-441e-97df-cdcd344db249 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:25.321430 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:25.343812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800bc14-f63c-441e-97df-cdcd344db249 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:25.380631 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2e9eb-aabe-4d79-b9d8-e7b92ba3e9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:25.381367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2e9eb-aabe-4d79-b9d8-e7b92ba3e9a6 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:25.381687 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2e9eb-aabe-4d79-b9d8-e7b92ba3e9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:25.381995 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2e9eb-aabe-4d79-b9d8-e7b92ba3e9a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:25.388723 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2e9eb-aabe-4d79-b9d8-e7b92ba3e9a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:25.390317 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2e9eb-aabe-4d79-b9d8-e7b92ba3e9a6 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-b0d2e9eb-aabe-4d79-b9d8-e7b92ba3e9a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:33:25.403669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:25.405225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:25.406449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:33:25.406449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:33:25.406449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:33:25.406449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:33:25.406449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:33:25.406449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:33:25.406449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:33:25.406449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:25.406449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 337/662] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:25.411637 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0afc79-b609-42a7-8b92-61894c03f64c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:25.490558 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:25.525862 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0afc79-b609-42a7-8b92-61894c03f64c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:25.567257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a80ba8-9c4b-4329-8f4e-05d071e16205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:25.567895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a80ba8-9c4b-4329-8f4e-05d071e16205 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:25.568172 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a80ba8-9c4b-4329-8f4e-05d071e16205 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:25.568440 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a80ba8-9c4b-4329-8f4e-05d071e16205 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:25.569208 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a80ba8-9c4b-4329-8f4e-05d071e16205 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:25.569513 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a80ba8-9c4b-4329-8f4e-05d071e16205 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:25.571014 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a80ba8-9c4b-4329-8f4e-05d071e16205 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:25.587582 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 326/663] 10.222.0.40 () {56 vars in 1148 bytes} [Sat Oct 29 20:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:33:25.593936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2e9eb-aabe-4d79-b9d8-e7b92ba3e9a6 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:25.707865 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2e9eb-aabe-4d79-b9d8-e7b92ba3e9a6 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:25.749085 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eda162-8d66-4d20-b6b3-c76614a0e001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:25.749757 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eda162-8d66-4d20-b6b3-c76614a0e001 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:25.750009 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eda162-8d66-4d20-b6b3-c76614a0e001 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:25.750296 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eda162-8d66-4d20-b6b3-c76614a0e001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:25.751214 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eda162-8d66-4d20-b6b3-c76614a0e001 None admin] RBAC: Adding query filter params (role.id=116e2c35edcf4173a8d203637a4237e0, scope.project.id=38c8029f1fc24cd098d360f54c51451d, user.id=d70c0c1dd66244b68052c278d9b39dce) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:25.751708 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eda162-8d66-4d20-b6b3-c76614a0e001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:25.753344 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eda162-8d66-4d20-b6b3-c76614a0e001 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:25.760768 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 338/664] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:33:25 2022] GET /identity/v3/role_assignments?user.id=d70c0c1dd66244b68052c278d9b39dce&scope.project.id=38c8029f1fc24cd098d360f54c51451d&role.id=116e2c35edcf4173a8d203637a4237e0 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:28.397593 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee2dbb-84c8-4246-bfa0-8f203b1fb5c7 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:28.398162 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee2dbb-84c8-4246-bfa0-8f203b1fb5c7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:28.398162 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee2dbb-84c8-4246-bfa0-8f203b1fb5c7 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:28.399491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 327/665] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:33:28.405789 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99bf0f-087e-44af-8aea-28a5aef41945 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:28.406256 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99bf0f-087e-44af-8aea-28a5aef41945 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:28.406362 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99bf0f-087e-44af-8aea-28a5aef41945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:28.419411 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:28.427448 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-af99bf0f-087e-44af-8aea-28a5aef41945 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:33:28.428747 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-af99bf0f-087e-44af-8aea-28a5aef41945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:33:28.504643 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 339/666] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:33:28 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:33:28.839064 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee2dbb-84c8-4246-bfa0-8f203b1fb5c7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:28.967052 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee2dbb-84c8-4246-bfa0-8f203b1fb5c7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:28.999163 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:29.006156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f632fbf-c580-4034-b26b-a538a10b4c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:29.008411 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f632fbf-c580-4034-b26b-a538a10b4c43 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:29.008689 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f632fbf-c580-4034-b26b-a538a10b4c43 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:29.008961 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f632fbf-c580-4034-b26b-a538a10b4c43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:29.020148 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f632fbf-c580-4034-b26b-a538a10b4c43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-8f632fbf-c580-4034-b26b-a538a10b4c43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:33:29.025257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:29.026981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:29.028678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:29.028678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:29.028678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:29.028678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:29.028678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:33:29.028678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:33:29.028678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:33:29.028678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:33:29.028678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:33:29.028678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:33:29.028678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:33:29.028678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:33:29.028678 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 328/667] 10.222.0.40 () {56 vars in 1096 bytes} [Sat Oct 29 20:33:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:29.034485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99bf0f-087e-44af-8aea-28a5aef41945 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:29.143027 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99bf0f-087e-44af-8aea-28a5aef41945 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:29.178639 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce3155-f143-4229-88b2-09d8debfc361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:29.179243 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce3155-f143-4229-88b2-09d8debfc361 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:29.179585 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce3155-f143-4229-88b2-09d8debfc361 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:29.179831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce3155-f143-4229-88b2-09d8debfc361 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:29.180459 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce3155-f143-4229-88b2-09d8debfc361 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:29.180754 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce3155-f143-4229-88b2-09d8debfc361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:29.182134 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce3155-f143-4229-88b2-09d8debfc361 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:29.187959 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:29.194504 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 340/668] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:33:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:29.200400 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f632fbf-c580-4034-b26b-a538a10b4c43 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:29.316511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f632fbf-c580-4034-b26b-a538a10b4c43 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:29.364687 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911bf72-ce54-4f5e-afa6-8bd933939f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:29.365500 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911bf72-ce54-4f5e-afa6-8bd933939f86 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:29.365889 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911bf72-ce54-4f5e-afa6-8bd933939f86 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:29.366234 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911bf72-ce54-4f5e-afa6-8bd933939f86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:29.378036 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911bf72-ce54-4f5e-afa6-8bd933939f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:29.379526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911bf72-ce54-4f5e-afa6-8bd933939f86 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-c911bf72-ce54-4f5e-afa6-8bd933939f86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:33:29.395767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:29.396978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:33:29.398543 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:33:29.398543 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:29.398543 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:33:29.398543 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 329/669] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:33:29.402978 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce3155-f143-4229-88b2-09d8debfc361 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:29.519587 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce3155-f143-4229-88b2-09d8debfc361 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:29.561351 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba9a29-0e3d-4032-bb48-4da509485ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:29.561959 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba9a29-0e3d-4032-bb48-4da509485ad4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:29.562237 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba9a29-0e3d-4032-bb48-4da509485ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:29.562504 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba9a29-0e3d-4032-bb48-4da509485ad4 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:29.563147 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba9a29-0e3d-4032-bb48-4da509485ad4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:29.563492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba9a29-0e3d-4032-bb48-4da509485ad4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:29.564862 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba9a29-0e3d-4032-bb48-4da509485ad4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:29.578712 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 341/670] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:29.584861 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911bf72-ce54-4f5e-afa6-8bd933939f86 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:29.633418 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:29.703912 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911bf72-ce54-4f5e-afa6-8bd933939f86 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:29.740799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902d1c3-71ee-49a3-ae8d-0dbdc21042ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:29.741465 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902d1c3-71ee-49a3-ae8d-0dbdc21042ec None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:29.741742 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902d1c3-71ee-49a3-ae8d-0dbdc21042ec None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:29.742044 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902d1c3-71ee-49a3-ae8d-0dbdc21042ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:29.750350 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902d1c3-71ee-49a3-ae8d-0dbdc21042ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:29.751951 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902d1c3-71ee-49a3-ae8d-0dbdc21042ec None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-f902d1c3-71ee-49a3-ae8d-0dbdc21042ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:33:29.764195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:29.765366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:29.766478 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:29.766478 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:29.766478 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:33:29.766478 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:33:29.766478 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:33:29.766478 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:33:29.766478 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:33:29.766478 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:33:29.766478 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 29 20:33:29.766478 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:33:29.766478 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 330/671] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:33:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:29.771167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba9a29-0e3d-4032-bb48-4da509485ad4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:29.834054 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:29.880315 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba9a29-0e3d-4032-bb48-4da509485ad4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:29.924519 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7ffd3-2657-4bfe-ac0e-a2de26b3237b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:29.925132 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7ffd3-2657-4bfe-ac0e-a2de26b3237b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:29.925400 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7ffd3-2657-4bfe-ac0e-a2de26b3237b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:29.925664 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7ffd3-2657-4bfe-ac0e-a2de26b3237b None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:29.926385 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7ffd3-2657-4bfe-ac0e-a2de26b3237b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:29.926684 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7ffd3-2657-4bfe-ac0e-a2de26b3237b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:29.928144 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7ffd3-2657-4bfe-ac0e-a2de26b3237b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:29.947076 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 342/672] 10.222.0.40 () {56 vars in 1143 bytes} [Sat Oct 29 20:33:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:29.953596 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902d1c3-71ee-49a3-ae8d-0dbdc21042ec None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:30.070476 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902d1c3-71ee-49a3-ae8d-0dbdc21042ec None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:30.071937 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:30.109534 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d814a9-99c4-440b-b1ad-1cae3464af8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:30.110162 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d814a9-99c4-440b-b1ad-1cae3464af8d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:30.110440 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d814a9-99c4-440b-b1ad-1cae3464af8d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:30.110710 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d814a9-99c4-440b-b1ad-1cae3464af8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:30.122171 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d814a9-99c4-440b-b1ad-1cae3464af8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:30.124812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d814a9-99c4-440b-b1ad-1cae3464af8d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-a4d814a9-99c4-440b-b1ad-1cae3464af8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:33:30.141103 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:30.142526 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:33:30.143631 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:33:30.143631 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:30.143631 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:33:30.143631 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 331/673] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:33:30.148028 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7ffd3-2657-4bfe-ac0e-a2de26b3237b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:30.265583 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7ffd3-2657-4bfe-ac0e-a2de26b3237b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:30.284535 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:30.306614 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdad93-33a1-4099-91ef-9272d5dbf96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:30.307464 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdad93-33a1-4099-91ef-9272d5dbf96a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:30.307899 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdad93-33a1-4099-91ef-9272d5dbf96a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:30.308317 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdad93-33a1-4099-91ef-9272d5dbf96a None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:30.309195 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdad93-33a1-4099-91ef-9272d5dbf96a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:30.309673 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdad93-33a1-4099-91ef-9272d5dbf96a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:30.312308 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdad93-33a1-4099-91ef-9272d5dbf96a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:30.326725 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 343/674] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 20:33:30.332503 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d814a9-99c4-440b-b1ad-1cae3464af8d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:30.443810 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d814a9-99c4-440b-b1ad-1cae3464af8d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:30.480094 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c2a6f-4084-4ec6-9797-3ad3f813648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:30.480737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c2a6f-4084-4ec6-9797-3ad3f813648f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:30.480988 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c2a6f-4084-4ec6-9797-3ad3f813648f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:30.481253 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c2a6f-4084-4ec6-9797-3ad3f813648f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:30.489228 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c2a6f-4084-4ec6-9797-3ad3f813648f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:30.490676 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c2a6f-4084-4ec6-9797-3ad3f813648f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-2c5c2a6f-4084-4ec6-9797-3ad3f813648f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:33:30.503628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:30.504635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:30.505553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:33:30.505553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:33:30.505553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:33:30.505553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:33:30.505553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:33:30.505553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:33:30.505553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:33:30.505553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:33:30.505553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 332/675] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:33:30.511164 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdad93-33a1-4099-91ef-9272d5dbf96a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:30.624750 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdad93-33a1-4099-91ef-9272d5dbf96a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:30.661486 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5294be2-bfca-43e6-93be-537fa641fb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:30.662234 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5294be2-bfca-43e6-93be-537fa641fb31 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:30.662569 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5294be2-bfca-43e6-93be-537fa641fb31 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:30.662875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5294be2-bfca-43e6-93be-537fa641fb31 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:30.663747 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5294be2-bfca-43e6-93be-537fa641fb31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:30.664080 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5294be2-bfca-43e6-93be-537fa641fb31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:30.665665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5294be2-bfca-43e6-93be-537fa641fb31 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:30.679754 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 344/676] 10.222.0.40 () {56 vars in 1148 bytes} [Sat Oct 29 20:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:30.686087 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c2a6f-4084-4ec6-9797-3ad3f813648f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:30.703778 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:30.800514 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c2a6f-4084-4ec6-9797-3ad3f813648f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:30.840964 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e8ae1-946e-4f23-b267-8bab6ee31f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:30.842642 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e8ae1-946e-4f23-b267-8bab6ee31f43 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:30.842642 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e8ae1-946e-4f23-b267-8bab6ee31f43 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:30.843017 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e8ae1-946e-4f23-b267-8bab6ee31f43 None admin] PATH_INFO: `/v3/projects/38c8029f1fc24cd098d360f54c51451d/users/d70c0c1dd66244b68052c278d9b39dce/roles/9b15e747c88749bfb25139f3bd80b395` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:30.844954 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e8ae1-946e-4f23-b267-8bab6ee31f43 None admin] RBAC: Authorizing `identity:create_grant(project_id=38c8029f1fc24cd098d360f54c51451d, user_id=d70c0c1dd66244b68052c278d9b39dce, role_id=9b15e747c88749bfb25139f3bd80b395)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:30.846412 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e8ae1-946e-4f23-b267-8bab6ee31f43 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:30.862772 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 333/677] 10.222.0.40 () {58 vars in 1439 bytes} [Sat Oct 29 20:33:30 2022] PUT /identity/v3/projects/38c8029f1fc24cd098d360f54c51451d/users/d70c0c1dd66244b68052c278d9b39dce/roles/9b15e747c88749bfb25139f3bd80b395 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:33:33.436278 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c669f4-6985-4675-b9dc-f44961eca754 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:33.436796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c669f4-6985-4675-b9dc-f44961eca754 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:33.436796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c669f4-6985-4675-b9dc-f44961eca754 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:33.438165 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 345/678] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:33:33.443490 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7cc9b-74dd-49aa-aa8b-ff292df34ffb None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:33.443888 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7cc9b-74dd-49aa-aa8b-ff292df34ffb None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:33.444031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7cc9b-74dd-49aa-aa8b-ff292df34ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:33.462517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-8cc7cc9b-74dd-49aa-aa8b-ff292df34ffb None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:33:33.463731 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8cc7cc9b-74dd-49aa-aa8b-ff292df34ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:33:33.527784 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 334/679] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:33:33 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:33:33.859066 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c669f4-6985-4675-b9dc-f44961eca754 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:33.894890 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:33.960027 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c669f4-6985-4675-b9dc-f44961eca754 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:33.993188 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e94336-8746-4029-bb78-0f518af28ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:33.993798 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e94336-8746-4029-bb78-0f518af28ef8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:33.994068 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e94336-8746-4029-bb78-0f518af28ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:33.994329 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e94336-8746-4029-bb78-0f518af28ef8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:34.004720 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e94336-8746-4029-bb78-0f518af28ef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-a0e94336-8746-4029-bb78-0f518af28ef8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 20:33:34.009450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:34.010529 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:34.011733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:34.011733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:34.011733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:34.011733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:34.011733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 20:33:34.011733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 20:33:34.011733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 20:33:34.011733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 20:33:34.011733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 20:33:34.011733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 20:33:34.011733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 20:33:34.011733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:34.011733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 346/680] 10.222.0.40 () {56 vars in 1096 bytes} [Sat Oct 29 20:33:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:34.017161 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7cc9b-74dd-49aa-aa8b-ff292df34ffb None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:34.020221 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:34.113940 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7cc9b-74dd-49aa-aa8b-ff292df34ffb None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:34.147026 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a831065-9a63-41f3-bb81-67f3ebba5142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:34.147640 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a831065-9a63-41f3-bb81-67f3ebba5142 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:34.147914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a831065-9a63-41f3-bb81-67f3ebba5142 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:34.148180 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a831065-9a63-41f3-bb81-67f3ebba5142 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:34.148831 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a831065-9a63-41f3-bb81-67f3ebba5142 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:34.149125 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a831065-9a63-41f3-bb81-67f3ebba5142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:34.150470 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a831065-9a63-41f3-bb81-67f3ebba5142 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:34.158547 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 335/681] 10.222.0.40 () {56 vars in 1099 bytes} [Sat Oct 29 20:33:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:34.164255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e94336-8746-4029-bb78-0f518af28ef8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:34.259811 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:34.267095 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e94336-8746-4029-bb78-0f518af28ef8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:34.300865 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec35189-6fed-4fa5-b9d0-50b4f74eb6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:34.301475 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec35189-6fed-4fa5-b9d0-50b4f74eb6a3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:34.301749 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec35189-6fed-4fa5-b9d0-50b4f74eb6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:34.302016 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec35189-6fed-4fa5-b9d0-50b4f74eb6a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:34.312258 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec35189-6fed-4fa5-b9d0-50b4f74eb6a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:34.313708 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec35189-6fed-4fa5-b9d0-50b4f74eb6a3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-3ec35189-6fed-4fa5-b9d0-50b4f74eb6a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:33:34.328416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:34.329492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:33:34.330619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:33:34.330619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:34.330619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:34.330619 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 347/682] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:34.335326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a831065-9a63-41f3-bb81-67f3ebba5142 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:34.397702 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:34.431446 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a831065-9a63-41f3-bb81-67f3ebba5142 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:34.463643 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b0354-a4f4-457e-b753-6aa7832aca21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:34.464232 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b0354-a4f4-457e-b753-6aa7832aca21 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:34.464481 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b0354-a4f4-457e-b753-6aa7832aca21 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:34.464744 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b0354-a4f4-457e-b753-6aa7832aca21 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:34.465368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b0354-a4f4-457e-b753-6aa7832aca21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:34.465661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b0354-a4f4-457e-b753-6aa7832aca21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:34.467014 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b0354-a4f4-457e-b753-6aa7832aca21 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:34.478064 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 336/683] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:34.483685 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec35189-6fed-4fa5-b9d0-50b4f74eb6a3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:34.582183 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec35189-6fed-4fa5-b9d0-50b4f74eb6a3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:34.615450 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a235ae-444e-4607-b5d2-ac6355a05eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:34.616067 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a235ae-444e-4607-b5d2-ac6355a05eee None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:34.616341 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a235ae-444e-4607-b5d2-ac6355a05eee None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:34.616610 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a235ae-444e-4607-b5d2-ac6355a05eee None admin] PATH_INFO: `/v3/users/placement` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:34.623973 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a235ae-444e-4607-b5d2-ac6355a05eee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:34.625400 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a235ae-444e-4607-b5d2-ac6355a05eee None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-a8a235ae-444e-4607-b5d2-ac6355a05eee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 20:33:34.636367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:34.637407 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:34.638909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:34.638909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:34.638909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 20:33:34.638909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 20:33:34.638909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 20:33:34.638909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 20:33:34.638909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 20:33:34.638909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 20:33:34.638909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 29 20:33:34.638909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:34.638909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 348/684] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:33:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 20:33:34.643134 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b0354-a4f4-457e-b753-6aa7832aca21 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:34.738744 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b0354-a4f4-457e-b753-6aa7832aca21 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:34.762529 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:34.771762 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b9d15-944d-4763-90d8-db8b8ae63241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:34.772360 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b9d15-944d-4763-90d8-db8b8ae63241 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:34.772631 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b9d15-944d-4763-90d8-db8b8ae63241 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:34.772897 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b9d15-944d-4763-90d8-db8b8ae63241 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:34.773615 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b9d15-944d-4763-90d8-db8b8ae63241 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:34.773920 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b9d15-944d-4763-90d8-db8b8ae63241 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:34.775355 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b9d15-944d-4763-90d8-db8b8ae63241 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:34.793208 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 337/685] 10.222.0.40 () {56 vars in 1143 bytes} [Sat Oct 29 20:33:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:34.800621 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a235ae-444e-4607-b5d2-ac6355a05eee None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:34.813672 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:34.907617 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a235ae-444e-4607-b5d2-ac6355a05eee None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:34.941030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39815daa-55e6-4089-a039-3be0a1cde62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:34.941625 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39815daa-55e6-4089-a039-3be0a1cde62f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:34.941904 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39815daa-55e6-4089-a039-3be0a1cde62f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:34.942171 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39815daa-55e6-4089-a039-3be0a1cde62f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:35.006511 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39815daa-55e6-4089-a039-3be0a1cde62f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:35.007934 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39815daa-55e6-4089-a039-3be0a1cde62f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:35.017648 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:35.107321 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 349/686] 10.222.0.40 () {58 vars in 1282 bytes} [Sat Oct 29 20:33:34 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 29 20:33:35.113086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b9d15-944d-4763-90d8-db8b8ae63241 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:35.209437 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b9d15-944d-4763-90d8-db8b8ae63241 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:35.241505 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08d633-2abd-4712-98d6-243aad49db1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:35.242123 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08d633-2abd-4712-98d6-243aad49db1d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:35.242397 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08d633-2abd-4712-98d6-243aad49db1d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:35.242666 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08d633-2abd-4712-98d6-243aad49db1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:35.253472 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08d633-2abd-4712-98d6-243aad49db1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:35.254888 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08d633-2abd-4712-98d6-243aad49db1d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-ac08d633-2abd-4712-98d6-243aad49db1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 20:33:35.271858 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:35.272936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 20:33:35.273859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 20:33:35.273859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 20:33:35.273859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:33:35.273859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 338/687] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:35.278485 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39815daa-55e6-4089-a039-3be0a1cde62f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:35.376412 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39815daa-55e6-4089-a039-3be0a1cde62f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:35.385287 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:35.410991 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f16f5-a7af-45f1-8a4f-53bafa9fb249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:35.411627 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f16f5-a7af-45f1-8a4f-53bafa9fb249 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:35.411903 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f16f5-a7af-45f1-8a4f-53bafa9fb249 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:35.412170 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f16f5-a7af-45f1-8a4f-53bafa9fb249 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:35.412800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f16f5-a7af-45f1-8a4f-53bafa9fb249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:35.413099 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f16f5-a7af-45f1-8a4f-53bafa9fb249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:35.414455 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f16f5-a7af-45f1-8a4f-53bafa9fb249 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:35.426083 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 350/688] 10.222.0.40 () {56 vars in 1109 bytes} [Sat Oct 29 20:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:35.431709 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08d633-2abd-4712-98d6-243aad49db1d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:35.465368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:35.529476 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08d633-2abd-4712-98d6-243aad49db1d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:35.562236 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0b7f-59f7-47d6-89f8-7578f2f2701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:35.562846 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0b7f-59f7-47d6-89f8-7578f2f2701b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:35.563124 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0b7f-59f7-47d6-89f8-7578f2f2701b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:35.563495 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0b7f-59f7-47d6-89f8-7578f2f2701b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:35.569934 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0b7f-59f7-47d6-89f8-7578f2f2701b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:35.571394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0b7f-59f7-47d6-89f8-7578f2f2701b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b80c0b7f-59f7-47d6-89f8-7578f2f2701b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 20:33:35.582971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:35.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:35.585139 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 20:33:35.585139 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 20:33:35.585139 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 20:33:35.585139 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 20:33:35.585139 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 20:33:35.585139 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 20:33:35.585139 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 20:33:35.585139 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: ERROR keystone.server.flask.application Oct 29 20:33:35.585139 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 339/689] 10.222.0.40 () {56 vars in 1111 bytes} [Sat Oct 29 20:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:35.589956 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f16f5-a7af-45f1-8a4f-53bafa9fb249 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:35.688588 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f16f5-a7af-45f1-8a4f-53bafa9fb249 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:35.721897 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768102fd-d3a9-4ce0-be62-42a0b1b41582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:35.722494 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768102fd-d3a9-4ce0-be62-42a0b1b41582 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:35.722774 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768102fd-d3a9-4ce0-be62-42a0b1b41582 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:35.723046 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768102fd-d3a9-4ce0-be62-42a0b1b41582 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:35.723761 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768102fd-d3a9-4ce0-be62-42a0b1b41582 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:35.724066 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768102fd-d3a9-4ce0-be62-42a0b1b41582 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:35.725491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768102fd-d3a9-4ce0-be62-42a0b1b41582 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:35.737076 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 351/690] 10.222.0.40 () {56 vars in 1148 bytes} [Sat Oct 29 20:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:35.742961 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0b7f-59f7-47d6-89f8-7578f2f2701b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:35.841909 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:35.848068 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0b7f-59f7-47d6-89f8-7578f2f2701b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:35.880638 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797f037-5e5d-41bc-bfe4-194d35381be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:35.881227 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797f037-5e5d-41bc-bfe4-194d35381be3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:35.881502 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797f037-5e5d-41bc-bfe4-194d35381be3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:35.881769 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797f037-5e5d-41bc-bfe4-194d35381be3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:35.882486 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797f037-5e5d-41bc-bfe4-194d35381be3 None admin] RBAC: Adding query filter params (role.id=9b15e747c88749bfb25139f3bd80b395, scope.project.id=38c8029f1fc24cd098d360f54c51451d, user.id=d70c0c1dd66244b68052c278d9b39dce) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:35.882792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797f037-5e5d-41bc-bfe4-194d35381be3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:35.884240 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797f037-5e5d-41bc-bfe4-194d35381be3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:35.890391 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 340/691] 10.222.0.40 () {56 vars in 1374 bytes} [Sat Oct 29 20:33:35 2022] GET /identity/v3/role_assignments?user.id=d70c0c1dd66244b68052c278d9b39dce&scope.project.id=38c8029f1fc24cd098d360f54c51451d&role.id=9b15e747c88749bfb25139f3bd80b395 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:38.404662 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0c64e-052a-4ef8-bc1f-547fbdd74a7c None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:38.405208 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0c64e-052a-4ef8-bc1f-547fbdd74a7c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:38.405208 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0c64e-052a-4ef8-bc1f-547fbdd74a7c None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:38.406517 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 352/692] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:33:38.411708 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80ed4-b94a-4c96-99a1-003ad3ed213b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:38.412122 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80ed4-b94a-4c96-99a1-003ad3ed213b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:38.412258 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80ed4-b94a-4c96-99a1-003ad3ed213b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:38.430326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-2dc80ed4-b94a-4c96-99a1-003ad3ed213b None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:33:38.431522 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2dc80ed4-b94a-4c96-99a1-003ad3ed213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:33:38.497243 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 341/693] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:33:38 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:33:38.820502 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0c64e-052a-4ef8-bc1f-547fbdd74a7c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:38.851256 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:38.926432 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0c64e-052a-4ef8-bc1f-547fbdd74a7c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:38.959110 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8557-ca50-4f4b-871a-2b4be6db58ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:38.959760 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8557-ca50-4f4b-871a-2b4be6db58ba None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:38.960038 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8557-ca50-4f4b-871a-2b4be6db58ba None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:38.960306 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8557-ca50-4f4b-871a-2b4be6db58ba None admin] PATH_INFO: `/v3/services/placement` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:38.960879 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d8557-ca50-4f4b-871a-2b4be6db58ba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:38.962227 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d8557-ca50-4f4b-871a-2b4be6db58ba None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-5d5d8557-ca50-4f4b-871a-2b4be6db58ba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:38.971272 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:38.972311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:38.973292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 353/694] 10.222.0.40 () {56 vars in 1117 bytes} [Sat Oct 29 20:33:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:38.978456 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc80ed4-b94a-4c96-99a1-003ad3ed213b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:39.066259 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:39.077122 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc80ed4-b94a-4c96-99a1-003ad3ed213b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:39.111070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60c41f-8e4a-49e7-8951-299f149356c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:39.111695 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60c41f-8e4a-49e7-8951-299f149356c6 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:39.111990 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60c41f-8e4a-49e7-8951-299f149356c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:39.112237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60c41f-8e4a-49e7-8951-299f149356c6 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:39.112856 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60c41f-8e4a-49e7-8951-299f149356c6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:39.113150 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60c41f-8e4a-49e7-8951-299f149356c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:39.114500 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60c41f-8e4a-49e7-8951-299f149356c6 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:39.119014 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 342/695] 10.222.0.40 () {56 vars in 1116 bytes} [Sat Oct 29 20:33:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:39.124985 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8557-ca50-4f4b-871a-2b4be6db58ba None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:39.214605 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:39.224193 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8557-ca50-4f4b-871a-2b4be6db58ba None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:39.257554 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e5f98-8331-4521-9d05-072332516395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:39.258156 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e5f98-8331-4521-9d05-072332516395 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:39.258440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e5f98-8331-4521-9d05-072332516395 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:39.258710 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e5f98-8331-4521-9d05-072332516395 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:39.259363 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e5f98-8331-4521-9d05-072332516395 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:39.259671 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e5f98-8331-4521-9d05-072332516395 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:39.261034 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e5f98-8331-4521-9d05-072332516395 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:39.265887 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 354/696] 10.222.0.40 () {56 vars in 1116 bytes} [Sat Oct 29 20:33:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:41.662397 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a30b9-0a9c-4f18-a9d1-49a21c78c611 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:41.662925 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a30b9-0a9c-4f18-a9d1-49a21c78c611 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:41.662925 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a30b9-0a9c-4f18-a9d1-49a21c78c611 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:41.664300 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 343/697] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:33:41.670458 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408e40a-5e3f-4264-ae2a-e5c64c16d2e8 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:41.670832 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408e40a-5e3f-4264-ae2a-e5c64c16d2e8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:41.671003 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408e40a-5e3f-4264-ae2a-e5c64c16d2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:41.690146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0408e40a-5e3f-4264-ae2a-e5c64c16d2e8 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:33:41.691338 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0408e40a-5e3f-4264-ae2a-e5c64c16d2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:33:41.756845 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 355/698] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:33:41 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:33:42.101297 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a30b9-0a9c-4f18-a9d1-49a21c78c611 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:42.199193 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a30b9-0a9c-4f18-a9d1-49a21c78c611 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:42.232497 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec6e00-f324-425f-a246-4d79b4bd7000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:42.233156 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec6e00-f324-425f-a246-4d79b4bd7000 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:42.233428 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec6e00-f324-425f-a246-4d79b4bd7000 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:42.233692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec6e00-f324-425f-a246-4d79b4bd7000 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:42.234334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec6e00-f324-425f-a246-4d79b4bd7000 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:42.235707 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec6e00-f324-425f-a246-4d79b4bd7000 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:42.252069 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 344/699] 10.222.0.40 () {60 vars in 1141 bytes} [Sat Oct 29 20:33:42 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:33:44.657782 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c3177-afab-4df6-a23f-db0a4753974b None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:44.658288 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c3177-afab-4df6-a23f-db0a4753974b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:44.658380 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c3177-afab-4df6-a23f-db0a4753974b None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:44.659710 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 356/700] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:33:44.664680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b138c5e-5db3-4ae9-afb4-db024812fed2 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:44.665062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b138c5e-5db3-4ae9-afb4-db024812fed2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:44.665216 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b138c5e-5db3-4ae9-afb4-db024812fed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:44.683936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0b138c5e-5db3-4ae9-afb4-db024812fed2 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:33:44.685892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0b138c5e-5db3-4ae9-afb4-db024812fed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:33:44.696519 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:44.758511 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 345/701] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:33:44 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:33:45.076148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c3177-afab-4df6-a23f-db0a4753974b None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:45.162312 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:45.179213 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c3177-afab-4df6-a23f-db0a4753974b None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:45.212544 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02598d4f-c246-4fdd-b75a-608238fa7967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:45.213167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02598d4f-c246-4fdd-b75a-608238fa7967 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:45.213443 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02598d4f-c246-4fdd-b75a-608238fa7967 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:45.213712 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02598d4f-c246-4fdd-b75a-608238fa7967 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:45.214284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02598d4f-c246-4fdd-b75a-608238fa7967 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:45.215688 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02598d4f-c246-4fdd-b75a-608238fa7967 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-02598d4f-c246-4fdd-b75a-608238fa7967 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:45.224796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:45.226065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:45.227167 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 357/702] 10.222.0.40 () {56 vars in 1117 bytes} [Sat Oct 29 20:33:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:45.232735 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b138c5e-5db3-4ae9-afb4-db024812fed2 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:45.329868 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b138c5e-5db3-4ae9-afb4-db024812fed2 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:45.362585 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008aa999-d931-4a8d-8fcb-3ab9f352f2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:45.363178 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa999-d931-4a8d-8fcb-3ab9f352f2a9 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:45.363485 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa999-d931-4a8d-8fcb-3ab9f352f2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:45.363755 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa999-d931-4a8d-8fcb-3ab9f352f2a9 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:45.364379 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008aa999-d931-4a8d-8fcb-3ab9f352f2a9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:45.364677 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008aa999-d931-4a8d-8fcb-3ab9f352f2a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:45.366025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008aa999-d931-4a8d-8fcb-3ab9f352f2a9 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:45.370830 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 346/703] 10.222.0.40 () {56 vars in 1116 bytes} [Sat Oct 29 20:33:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:45.376770 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02598d4f-c246-4fdd-b75a-608238fa7967 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:45.475919 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02598d4f-c246-4fdd-b75a-608238fa7967 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:45.508664 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b8f98-747a-4985-8c15-1188f7917f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:45.509253 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8f98-747a-4985-8c15-1188f7917f1c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:45.509532 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8f98-747a-4985-8c15-1188f7917f1c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:45.509802 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8f98-747a-4985-8c15-1188f7917f1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:45.510489 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b8f98-747a-4985-8c15-1188f7917f1c None admin] RBAC: Adding query filter params (interface=public, service_id=061457e979b44b009a038daec21eab43, region_id=RegionOne) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:45.510794 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b8f98-747a-4985-8c15-1188f7917f1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:45.512188 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b8f98-747a-4985-8c15-1188f7917f1c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:45.517752 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 358/704] 10.222.0.40 () {56 vars in 1251 bytes} [Sat Oct 29 20:33:45 2022] GET /identity/v3/endpoints?service_id=061457e979b44b009a038daec21eab43&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:45.523223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008aa999-d931-4a8d-8fcb-3ab9f352f2a9 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:45.526918 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:45.620171 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008aa999-d931-4a8d-8fcb-3ab9f352f2a9 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:45.652459 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752abdd-a992-4fdf-8de1-c5c6ecec5cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:45.653044 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752abdd-a992-4fdf-8de1-c5c6ecec5cd6 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:45.653318 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752abdd-a992-4fdf-8de1-c5c6ecec5cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:45.654207 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752abdd-a992-4fdf-8de1-c5c6ecec5cd6 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:45.654941 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752abdd-a992-4fdf-8de1-c5c6ecec5cd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:45.656341 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752abdd-a992-4fdf-8de1-c5c6ecec5cd6 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:45.662497 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 347/705] 10.222.0.40 () {56 vars in 1087 bytes} [Sat Oct 29 20:33:45 2022] GET /identity/v3/services => generated 1962 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 20:33:48.135783 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c6a3d-4408-45de-b142-2d5ab5446362 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:48.136338 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c6a3d-4408-45de-b142-2d5ab5446362 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:48.136338 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c6a3d-4408-45de-b142-2d5ab5446362 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:48.137638 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 359/706] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:33:48.143108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96374423-54d1-4f47-a245-6260a87275be None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:48.143555 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96374423-54d1-4f47-a245-6260a87275be None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:48.143681 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96374423-54d1-4f47-a245-6260a87275be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:48.162033 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-96374423-54d1-4f47-a245-6260a87275be None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:33:48.163198 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-96374423-54d1-4f47-a245-6260a87275be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:33:48.223714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:48.229016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 348/707] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:33:48 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 20:33:48.549550 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c6a3d-4408-45de-b142-2d5ab5446362 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:48.565933 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:48.650037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c6a3d-4408-45de-b142-2d5ab5446362 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:48.689200 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348877c-4e92-4d89-9337-ee85787f7083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:48.689812 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348877c-4e92-4d89-9337-ee85787f7083 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:48.690082 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348877c-4e92-4d89-9337-ee85787f7083 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:48.690344 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348877c-4e92-4d89-9337-ee85787f7083 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:48.690911 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348877c-4e92-4d89-9337-ee85787f7083 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:48.692298 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348877c-4e92-4d89-9337-ee85787f7083 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-3348877c-4e92-4d89-9337-ee85787f7083 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 20:33:48.701908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 20:33:48.707468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: ERROR keystone.server.flask.application Oct 29 20:33:48.708598 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 360/708] 10.222.0.40 () {56 vars in 1117 bytes} [Sat Oct 29 20:33:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 20:33:48.710809 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96374423-54d1-4f47-a245-6260a87275be None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:48.811860 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96374423-54d1-4f47-a245-6260a87275be None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:48.849489 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecf5ee-886d-4af3-83d5-359fa020ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:48.850126 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecf5ee-886d-4af3-83d5-359fa020ed2a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:48.850414 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecf5ee-886d-4af3-83d5-359fa020ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:48.850641 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecf5ee-886d-4af3-83d5-359fa020ed2a None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:48.851257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecf5ee-886d-4af3-83d5-359fa020ed2a None admin] RBAC: Adding query filter params (name=placement) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:33:48.851588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecf5ee-886d-4af3-83d5-359fa020ed2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:48.853085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecf5ee-886d-4af3-83d5-359fa020ed2a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:48.858960 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 349/709] 10.222.0.40 () {56 vars in 1116 bytes} [Sat Oct 29 20:33:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:33:48.865152 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348877c-4e92-4d89-9337-ee85787f7083 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:33:48.948442 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:48.970665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348877c-4e92-4d89-9337-ee85787f7083 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:33:49.003787 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834e62e-a0d3-4618-b2f7-9afa4747c314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:33:49.004385 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834e62e-a0d3-4618-b2f7-9afa4747c314 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:33:49.004666 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834e62e-a0d3-4618-b2f7-9afa4747c314 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:33:49.004938 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834e62e-a0d3-4618-b2f7-9afa4747c314 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:33:49.005592 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834e62e-a0d3-4618-b2f7-9afa4747c314 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:33:49.006962 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834e62e-a0d3-4618-b2f7-9afa4747c314 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:33:49.026691 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 361/710] 10.222.0.40 () {60 vars in 1144 bytes} [Sat Oct 29 20:33:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:33:58.855387 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=69 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:33:59.022458 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:34:49.374903 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d19e6-045f-4181-b7be-d78a82f43d19 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:49.374903 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d19e6-045f-4181-b7be-d78a82f43d19 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:49.374903 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d19e6-045f-4181-b7be-d78a82f43d19 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:49.376267 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 350/711] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:34:49.381777 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe7a5f-f1c8-4822-ba03-f6a55ca57074 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:49.382192 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe7a5f-f1c8-4822-ba03-f6a55ca57074 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:49.382536 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe7a5f-f1c8-4822-ba03-f6a55ca57074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:49.411494 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a6fe7a5f-f1c8-4822-ba03-f6a55ca57074 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:34:49.412852 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a6fe7a5f-f1c8-4822-ba03-f6a55ca57074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:34:49.483903 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 362/712] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:34:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:34:49.854212 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cefc14-2392-46c3-ae80-db6720371af9 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:49.854504 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cefc14-2392-46c3-ae80-db6720371af9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:49.854812 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cefc14-2392-46c3-ae80-db6720371af9 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:49.856292 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 351/713] 10.222.0.40 () {54 vars in 965 bytes} [Sat Oct 29 20:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:34:49.862780 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2f3ee-ab44-41ec-92d6-7fb8f54139bd None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:49.863233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2f3ee-ab44-41ec-92d6-7fb8f54139bd None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:49.863623 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2f3ee-ab44-41ec-92d6-7fb8f54139bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:49.918011 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b7f2f3ee-ab44-41ec-92d6-7fb8f54139bd None None] MFA Rules not processed for user `d1a02361a67a4e40b4683042a4439204`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:34:49.919186 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b7f2f3ee-ab44-41ec-92d6-7fb8f54139bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:34:49.978900 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 363/714] 10.222.0.40 () {58 vars in 1062 bytes} [Sat Oct 29 20:34:49 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:34:49.988225 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cefc14-2392-46c3-ae80-db6720371af9 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:34:49.999091 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cefc14-2392-46c3-ae80-db6720371af9 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:34:50.002693 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df125036-9b19-46f9-a8d4-d0fa7004455e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:34:50.003345 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df125036-9b19-46f9-a8d4-d0fa7004455e service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:50.003623 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df125036-9b19-46f9-a8d4-d0fa7004455e service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:50.003908 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df125036-9b19-46f9-a8d4-d0fa7004455e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:50.014447 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df125036-9b19-46f9-a8d4-d0fa7004455e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:34:50.015926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df125036-9b19-46f9-a8d4-d0fa7004455e service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:34:50.026501 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 352/715] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:34:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 20:34:52.769710 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa5dbe-fbf7-43bf-b3cc-8a468922e1ee None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:52.770252 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa5dbe-fbf7-43bf-b3cc-8a468922e1ee None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:52.770252 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa5dbe-fbf7-43bf-b3cc-8a468922e1ee None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:52.771674 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 364/716] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:34:52.777334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97cd84-fe7c-482e-89fa-e3cb39931120 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:52.777837 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97cd84-fe7c-482e-89fa-e3cb39931120 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:52.778017 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97cd84-fe7c-482e-89fa-e3cb39931120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:52.799666 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-7f97cd84-fe7c-482e-89fa-e3cb39931120 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:34:52.800987 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7f97cd84-fe7c-482e-89fa-e3cb39931120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:34:52.810086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 353/717] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:34:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:34:53.165965 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa5dbe-fbf7-43bf-b3cc-8a468922e1ee None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:34:53.178044 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa5dbe-fbf7-43bf-b3cc-8a468922e1ee None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:34:53.181438 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39632c3-f770-4630-87e4-f5d27317fff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:34:53.182047 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39632c3-f770-4630-87e4-f5d27317fff8 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:53.182318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39632c3-f770-4630-87e4-f5d27317fff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:53.182582 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39632c3-f770-4630-87e4-f5d27317fff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:53.193848 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39632c3-f770-4630-87e4-f5d27317fff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:34:53.195326 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39632c3-f770-4630-87e4-f5d27317fff8 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:34:53.206991 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 365/718] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:34:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:34:55.948813 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5d1e-248c-48a0-9bcd-0528bd76daa3 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:55.949395 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5d1e-248c-48a0-9bcd-0528bd76daa3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:55.949395 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5d1e-248c-48a0-9bcd-0528bd76daa3 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:55.950899 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 354/719] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:34:55.956298 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8f193-db25-46bc-a677-c67b6143d7c7 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:55.956709 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8f193-db25-46bc-a677-c67b6143d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:55.956870 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8f193-db25-46bc-a677-c67b6143d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:55.994192 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-02e8f193-db25-46bc-a677-c67b6143d7c7 None None] MFA Rules not processed for user `3ffe1b6ef2a747b697f39f0d31ecd7db`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:34:55.995404 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-02e8f193-db25-46bc-a677-c67b6143d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:34:56.037708 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:34:56.065856 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 366/720] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:34:55 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:34:56.409274 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe5d1e-248c-48a0-9bcd-0528bd76daa3 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:34:56.420767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe5d1e-248c-48a0-9bcd-0528bd76daa3 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:34:56.424624 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0420ea6-6deb-4c65-b591-4776b2d63af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:34:56.425245 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420ea6-6deb-4c65-b591-4776b2d63af7 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:56.425517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420ea6-6deb-4c65-b591-4776b2d63af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:56.425782 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420ea6-6deb-4c65-b591-4776b2d63af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:56.435418 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0420ea6-6deb-4c65-b591-4776b2d63af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:34:56.436879 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0420ea6-6deb-4c65-b591-4776b2d63af7 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:34:56.447212 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 355/721] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:34:56 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:34:59.383027 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ffd99-38b3-4dd3-a42e-31f30daa51ca None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:59.383566 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ffd99-38b3-4dd3-a42e-31f30daa51ca None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:59.383678 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ffd99-38b3-4dd3-a42e-31f30daa51ca None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:59.384932 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 367/722] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:34:59.390716 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed0640-8035-4875-b534-99b5743dd6d9 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:59.391141 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed0640-8035-4875-b534-99b5743dd6d9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:59.391286 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed0640-8035-4875-b534-99b5743dd6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:59.411030 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-a8ed0640-8035-4875-b534-99b5743dd6d9 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:34:59.412246 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a8ed0640-8035-4875-b534-99b5743dd6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:34:59.484223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 356/723] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:34:59 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:34:59.847366 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151dac1-45cc-47ef-82b2-81ddef44642a None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:59.847647 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151dac1-45cc-47ef-82b2-81ddef44642a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:59.847917 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151dac1-45cc-47ef-82b2-81ddef44642a None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:59.849243 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 368/724] 10.222.0.40 () {54 vars in 965 bytes} [Sat Oct 29 20:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:34:59.856286 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812a790-5397-4269-bd52-8e47ad91731c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:59.856577 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812a790-5397-4269-bd52-8e47ad91731c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:59.856855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812a790-5397-4269-bd52-8e47ad91731c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:59.876092 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f812a790-5397-4269-bd52-8e47ad91731c None None] MFA Rules not processed for user `d1a02361a67a4e40b4683042a4439204`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:34:59.877273 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f812a790-5397-4269-bd52-8e47ad91731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:34:59.883631 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 357/725] 10.222.0.40 () {58 vars in 1062 bytes} [Sat Oct 29 20:34:59 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:34:59.892466 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151dac1-45cc-47ef-82b2-81ddef44642a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:34:59.903706 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151dac1-45cc-47ef-82b2-81ddef44642a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:34:59.907333 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d7abb-158c-4951-aaa1-2b2d7fac3fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:34:59.907913 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d7abb-158c-4951-aaa1-2b2d7fac3fbb service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:34:59.908187 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d7abb-158c-4951-aaa1-2b2d7fac3fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:34:59.908456 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d7abb-158c-4951-aaa1-2b2d7fac3fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:34:59.916956 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d7abb-158c-4951-aaa1-2b2d7fac3fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:34:59.919378 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d7abb-158c-4951-aaa1-2b2d7fac3fbb service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:34:59.928678 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 369/726] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:34:59 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:35:03.544376 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969f1f1-228f-432f-8f6a-078710f8992b None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:03.544917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969f1f1-228f-432f-8f6a-078710f8992b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:03.544917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969f1f1-228f-432f-8f6a-078710f8992b None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:03.546309 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 358/727] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:03.551678 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000c36a-69b1-48e7-af05-738a7afe6a4f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:03.552109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000c36a-69b1-48e7-af05-738a7afe6a4f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:03.552225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000c36a-69b1-48e7-af05-738a7afe6a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:03.571713 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a000c36a-69b1-48e7-af05-738a7afe6a4f None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:03.572889 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a000c36a-69b1-48e7-af05-738a7afe6a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:03.581323 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 370/728] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:35:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:35:03.919229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969f1f1-228f-432f-8f6a-078710f8992b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:35:03.930114 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969f1f1-228f-432f-8f6a-078710f8992b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:35:03.934211 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a8295-adc5-4b54-90ab-2d1994b4bf31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:35:03.934796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a8295-adc5-4b54-90ab-2d1994b4bf31 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:03.935097 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a8295-adc5-4b54-90ab-2d1994b4bf31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:03.935401 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a8295-adc5-4b54-90ab-2d1994b4bf31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:03.944298 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a8295-adc5-4b54-90ab-2d1994b4bf31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:35:03.945758 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a8295-adc5-4b54-90ab-2d1994b4bf31 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:35:03.955889 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 359/729] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:35:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:35:06.416957 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad420495-5525-4512-a021-19aff0a30a17 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:06.418127 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad420495-5525-4512-a021-19aff0a30a17 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:06.418127 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad420495-5525-4512-a021-19aff0a30a17 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:06.419593 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 371/730] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:06.424773 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17690cd-799c-47f2-83b1-d80099a3acb2 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:06.425195 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17690cd-799c-47f2-83b1-d80099a3acb2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:06.425330 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17690cd-799c-47f2-83b1-d80099a3acb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:06.444475 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-a17690cd-799c-47f2-83b1-d80099a3acb2 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:06.445659 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a17690cd-799c-47f2-83b1-d80099a3acb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:06.453482 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 360/731] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:35:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:06.791784 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad420495-5525-4512-a021-19aff0a30a17 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:35:06.803430 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad420495-5525-4512-a021-19aff0a30a17 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:35:06.807016 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed911664-42f5-4ead-9e99-d12f2104f92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:35:06.807634 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911664-42f5-4ead-9e99-d12f2104f92a service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:06.807915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911664-42f5-4ead-9e99-d12f2104f92a service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:06.809247 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911664-42f5-4ead-9e99-d12f2104f92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:06.818089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed911664-42f5-4ead-9e99-d12f2104f92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:35:06.819538 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed911664-42f5-4ead-9e99-d12f2104f92a service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:35:06.829354 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 372/732] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:35:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:35:09.356885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87273f43-5443-443e-9989-2ca4d04f2be8 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:09.357443 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87273f43-5443-443e-9989-2ca4d04f2be8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:09.357443 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87273f43-5443-443e-9989-2ca4d04f2be8 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:09.358736 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 361/733] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:09.363988 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8755b-ce33-4d0c-83d5-e576fb85d3a6 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:09.364375 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8755b-ce33-4d0c-83d5-e576fb85d3a6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:09.364663 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8755b-ce33-4d0c-83d5-e576fb85d3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:09.384087 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-66b8755b-ce33-4d0c-83d5-e576fb85d3a6 None None] MFA Rules not processed for user `3ffe1b6ef2a747b697f39f0d31ecd7db`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:09.385263 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-66b8755b-ce33-4d0c-83d5-e576fb85d3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:09.393712 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 373/734] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:35:09 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:09.727092 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87273f43-5443-443e-9989-2ca4d04f2be8 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:35:09.738250 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87273f43-5443-443e-9989-2ca4d04f2be8 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:35:09.741706 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5776c1-dca9-4447-b267-00872959fe3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:35:09.742293 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5776c1-dca9-4447-b267-00872959fe3c service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:09.742569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5776c1-dca9-4447-b267-00872959fe3c service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:09.742835 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5776c1-dca9-4447-b267-00872959fe3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:09.752430 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5776c1-dca9-4447-b267-00872959fe3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:35:09.753854 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5776c1-dca9-4447-b267-00872959fe3c service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:35:09.763218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 362/735] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:35:09 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:35:12.432438 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a05965-4ea7-4ce2-86e1-6d11afe631bb None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:12.432894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a05965-4ea7-4ce2-86e1-6d11afe631bb None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:12.433103 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a05965-4ea7-4ce2-86e1-6d11afe631bb None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:12.435006 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 374/736] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:12.440359 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e20f8f-a42a-4105-8b2b-efe896b47452 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:12.440759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e20f8f-a42a-4105-8b2b-efe896b47452 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:12.440898 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e20f8f-a42a-4105-8b2b-efe896b47452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:12.461337 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-18e20f8f-a42a-4105-8b2b-efe896b47452 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:12.462537 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-18e20f8f-a42a-4105-8b2b-efe896b47452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:12.471549 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 363/737] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:35:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:12.812229 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a05965-4ea7-4ce2-86e1-6d11afe631bb None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:35:12.822924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a05965-4ea7-4ce2-86e1-6d11afe631bb None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:35:12.826779 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29225d53-780e-4b42-8977-4facf3abdce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:35:12.827482 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29225d53-780e-4b42-8977-4facf3abdce9 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:12.827758 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29225d53-780e-4b42-8977-4facf3abdce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:12.828024 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29225d53-780e-4b42-8977-4facf3abdce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:12.837130 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29225d53-780e-4b42-8977-4facf3abdce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:35:12.838492 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29225d53-780e-4b42-8977-4facf3abdce9 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:35:12.849087 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 375/738] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:35:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:35:15.368270 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aff898-8ef3-4a13-a475-b89fac0a6d12 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:15.368814 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aff898-8ef3-4a13-a475-b89fac0a6d12 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:15.368814 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aff898-8ef3-4a13-a475-b89fac0a6d12 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:15.370111 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 364/739] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:15.376252 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb0d7c-8cb6-487c-8d15-17e5d80e9997 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:15.376682 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb0d7c-8cb6-487c-8d15-17e5d80e9997 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:15.376806 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb0d7c-8cb6-487c-8d15-17e5d80e9997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:15.396510 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b0bb0d7c-8cb6-487c-8d15-17e5d80e9997 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:15.397705 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b0bb0d7c-8cb6-487c-8d15-17e5d80e9997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:15.405451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 376/740] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:35:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:15.755913 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aff898-8ef3-4a13-a475-b89fac0a6d12 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:35:15.769854 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aff898-8ef3-4a13-a475-b89fac0a6d12 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:35:15.775293 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723e585-6824-4fd2-99fc-22cf31285f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:35:15.776247 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723e585-6824-4fd2-99fc-22cf31285f57 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:15.777365 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723e585-6824-4fd2-99fc-22cf31285f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:15.777741 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723e585-6824-4fd2-99fc-22cf31285f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:15.786280 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723e585-6824-4fd2-99fc-22cf31285f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:35:15.787733 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723e585-6824-4fd2-99fc-22cf31285f57 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:35:15.796871 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 365/741] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:35:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:35:18.504802 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401877-5aef-4d11-bc61-9fba36495ed0 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:18.505358 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401877-5aef-4d11-bc61-9fba36495ed0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:18.505358 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401877-5aef-4d11-bc61-9fba36495ed0 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:18.506595 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 377/742] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:18.511823 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18bf5b-2aa9-4d86-895d-e2cda60e0968 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:18.512223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18bf5b-2aa9-4d86-895d-e2cda60e0968 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:18.512364 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18bf5b-2aa9-4d86-895d-e2cda60e0968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:18.531636 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-cf18bf5b-2aa9-4d86-895d-e2cda60e0968 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:18.532791 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cf18bf5b-2aa9-4d86-895d-e2cda60e0968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:18.540366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 366/743] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:35:18 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:18.870573 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50401877-5aef-4d11-bc61-9fba36495ed0 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:35:18.881335 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50401877-5aef-4d11-bc61-9fba36495ed0 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:35:18.884765 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3b468-1580-48a3-8d6c-efb943b5878a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:35:18.885349 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3b468-1580-48a3-8d6c-efb943b5878a service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:18.885626 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3b468-1580-48a3-8d6c-efb943b5878a service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:18.885895 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3b468-1580-48a3-8d6c-efb943b5878a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:18.895107 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3b468-1580-48a3-8d6c-efb943b5878a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:35:18.896572 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3b468-1580-48a3-8d6c-efb943b5878a service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:35:18.906214 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 378/744] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:35:18 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:35:23.307556 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32dae0-b45a-4366-96c5-cc63ba7b5cef None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:23.308304 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32dae0-b45a-4366-96c5-cc63ba7b5cef None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:23.308406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32dae0-b45a-4366-96c5-cc63ba7b5cef None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:23.309714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 367/745] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:23.314977 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49320-28da-446f-a966-36613fc1b016 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:23.315409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49320-28da-446f-a966-36613fc1b016 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:23.315656 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49320-28da-446f-a966-36613fc1b016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:23.335230 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c7d49320-28da-446f-a966-36613fc1b016 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:23.336449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c7d49320-28da-446f-a966-36613fc1b016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:23.344623 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 379/746] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:35:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:23.679474 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32dae0-b45a-4366-96c5-cc63ba7b5cef None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:35:23.685480 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=77 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:35:23.691877 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32dae0-b45a-4366-96c5-cc63ba7b5cef None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:35:23.695352 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becb7a1-a30a-4a39-b889-ad463efb17c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:35:23.695939 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becb7a1-a30a-4a39-b889-ad463efb17c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:23.696208 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becb7a1-a30a-4a39-b889-ad463efb17c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:23.696472 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becb7a1-a30a-4a39-b889-ad463efb17c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:23.706345 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3becb7a1-a30a-4a39-b889-ad463efb17c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:35:23.707801 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3becb7a1-a30a-4a39-b889-ad463efb17c7 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:35:23.717586 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 368/747] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:35:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:35:26.805003 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0f708-8422-479a-8632-8dd3452390e6 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:26.805003 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0f708-8422-479a-8632-8dd3452390e6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:26.805790 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0f708-8422-479a-8632-8dd3452390e6 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:26.806681 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 380/748] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:26.813465 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040d909-0f67-438a-a599-c116d5a0d2c3 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:26.813969 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040d909-0f67-438a-a599-c116d5a0d2c3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:26.814060 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040d909-0f67-438a-a599-c116d5a0d2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:26.836981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-5040d909-0f67-438a-a599-c116d5a0d2c3 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:26.838130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5040d909-0f67-438a-a599-c116d5a0d2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:26.847251 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 369/749] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:35:26 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:27.190505 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0f708-8422-479a-8632-8dd3452390e6 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:35:27.196080 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=48 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:35:27.203546 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0f708-8422-479a-8632-8dd3452390e6 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:35:27.207001 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df39ea9-a985-4804-a9b1-241b700af97b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:35:27.207639 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df39ea9-a985-4804-a9b1-241b700af97b service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:27.207924 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df39ea9-a985-4804-a9b1-241b700af97b service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:27.208197 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df39ea9-a985-4804-a9b1-241b700af97b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:27.217790 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df39ea9-a985-4804-a9b1-241b700af97b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:35:27.219225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df39ea9-a985-4804-a9b1-241b700af97b service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:35:27.228788 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 381/750] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:35:27 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:35:31.802810 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57737c-68da-4836-9e5f-4167f14b4bc0 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:31.803378 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57737c-68da-4836-9e5f-4167f14b4bc0 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:31.803475 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57737c-68da-4836-9e5f-4167f14b4bc0 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:31.805164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 370/751] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:31.812260 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d553d4d-ae39-4b39-a8b1-3227edce6726 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:31.812757 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d553d4d-ae39-4b39-a8b1-3227edce6726 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:31.812893 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d553d4d-ae39-4b39-a8b1-3227edce6726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:31.833126 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-2d553d4d-ae39-4b39-a8b1-3227edce6726 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:31.834315 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2d553d4d-ae39-4b39-a8b1-3227edce6726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:31.842094 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 382/752] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:35:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:35:32.178799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57737c-68da-4836-9e5f-4167f14b4bc0 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:35:32.190105 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57737c-68da-4836-9e5f-4167f14b4bc0 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:35:32.193589 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b883615-5bae-4079-b9fb-5a830efa7ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:35:32.194185 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b883615-5bae-4079-b9fb-5a830efa7ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:32.194457 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b883615-5bae-4079-b9fb-5a830efa7ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:32.194726 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b883615-5bae-4079-b9fb-5a830efa7ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:32.204230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b883615-5bae-4079-b9fb-5a830efa7ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:35:32.205660 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b883615-5bae-4079-b9fb-5a830efa7ae5 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:35:32.216666 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 371/753] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:35:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:35:37.762808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed357e08-9ab8-413a-9116-21f35d21d070 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:37.763838 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed357e08-9ab8-413a-9116-21f35d21d070 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:37.764449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed357e08-9ab8-413a-9116-21f35d21d070 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:37.766315 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 383/754] 10.222.0.40 () {54 vars in 921 bytes} [Sat Oct 29 20:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:37.772782 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611be10-4b83-4951-ae06-0a3d4406eb6c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:37.773728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611be10-4b83-4951-ae06-0a3d4406eb6c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:37.774218 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611be10-4b83-4951-ae06-0a3d4406eb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:37.841121 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-a611be10-4b83-4951-ae06-0a3d4406eb6c None None] MFA Rules not processed for user `d70c0c1dd66244b68052c278d9b39dce`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:37.843761 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a611be10-4b83-4951-ae06-0a3d4406eb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:37.936285 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 372/755] 10.222.0.40 () {58 vars in 1018 bytes} [Sat Oct 29 20:35:37 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:35:41.828106 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=8 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:35:42.424820 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683efaf-32da-4eb8-a0d6-ba2155085ae3 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:42.425170 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683efaf-32da-4eb8-a0d6-ba2155085ae3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:42.425390 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683efaf-32da-4eb8-a0d6-ba2155085ae3 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:42.426879 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 384/756] 10.222.0.40 () {54 vars in 921 bytes} [Sat Oct 29 20:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:42.431730 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccd4bf-3463-4122-aae9-035c7fbc2e0a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:42.432182 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccd4bf-3463-4122-aae9-035c7fbc2e0a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:42.432276 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccd4bf-3463-4122-aae9-035c7fbc2e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:42.576608 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-04ccd4bf-3463-4122-aae9-035c7fbc2e0a None None] MFA Rules not processed for user `d70c0c1dd66244b68052c278d9b39dce`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:42.577854 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-04ccd4bf-3463-4122-aae9-035c7fbc2e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:42.587270 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 373/757] 10.222.0.40 () {58 vars in 1018 bytes} [Sat Oct 29 20:35:42 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:44.248897 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db3355-3b5a-4fc0-b8c5-73aa763df99f None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:44.249300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db3355-3b5a-4fc0-b8c5-73aa763df99f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:44.249400 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db3355-3b5a-4fc0-b8c5-73aa763df99f None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:44.250764 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 385/758] 10.222.0.40 () {54 vars in 921 bytes} [Sat Oct 29 20:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:44.256242 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b1c0c-8074-4aa8-b0ab-250d7ff3933f None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:44.256748 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b1c0c-8074-4aa8-b0ab-250d7ff3933f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:44.257291 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b1c0c-8074-4aa8-b0ab-250d7ff3933f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:44.277682 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f94b1c0c-8074-4aa8-b0ab-250d7ff3933f None None] MFA Rules not processed for user `d70c0c1dd66244b68052c278d9b39dce`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:44.278841 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f94b1c0c-8074-4aa8-b0ab-250d7ff3933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:44.287065 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 374/759] 10.222.0.40 () {58 vars in 1018 bytes} [Sat Oct 29 20:35:44 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:35:48.204162 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81014f53-814b-4e6c-bbc5-378e60b0ccf0 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:48.204732 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81014f53-814b-4e6c-bbc5-378e60b0ccf0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:48.204732 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81014f53-814b-4e6c-bbc5-378e60b0ccf0 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:48.206030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 386/760] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:48.211155 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288d22a-711d-4567-8781-a582f6141acd None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:48.211612 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288d22a-711d-4567-8781-a582f6141acd None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:48.211723 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288d22a-711d-4567-8781-a582f6141acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:48.231998 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b288d22a-711d-4567-8781-a582f6141acd None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:48.233406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b288d22a-711d-4567-8781-a582f6141acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:48.244348 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 375/761] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:35:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:48.596906 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b942671-5b14-48e9-a867-949d0f881b35 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:48.598292 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b942671-5b14-48e9-a867-949d0f881b35 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:48.598954 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b942671-5b14-48e9-a867-949d0f881b35 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:48.601692 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 387/762] 10.222.0.40 () {54 vars in 961 bytes} [Sat Oct 29 20:35:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:48.610395 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b448-2ed7-4fb6-87ee-21f6bbc90f22 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:48.611016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b448-2ed7-4fb6-87ee-21f6bbc90f22 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:48.611292 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b448-2ed7-4fb6-87ee-21f6bbc90f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:48.651683 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-25c1b448-2ed7-4fb6-87ee-21f6bbc90f22 None None] MFA Rules not processed for user `b61b58116d364480aed22b5715f6a78a`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:48.653231 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-25c1b448-2ed7-4fb6-87ee-21f6bbc90f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:48.725948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:35:48.733537 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 376/763] 10.222.0.40 () {58 vars in 1058 bytes} [Sat Oct 29 20:35:48 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:48.741151 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b942671-5b14-48e9-a867-949d0f881b35 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:35:48.755426 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b942671-5b14-48e9-a867-949d0f881b35 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:35:48.760233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fa354-7c5c-419f-8743-9f381c6282de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:35:48.760852 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fa354-7c5c-419f-8743-9f381c6282de service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:48.761143 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fa354-7c5c-419f-8743-9f381c6282de service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:48.761401 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fa354-7c5c-419f-8743-9f381c6282de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:48.770318 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fa354-7c5c-419f-8743-9f381c6282de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:35:48.771952 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fa354-7c5c-419f-8743-9f381c6282de service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:35:48.781972 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 388/764] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:35:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:35:51.462595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869d3a8-b89b-4f3b-8142-2a28f93e616f None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:51.463024 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869d3a8-b89b-4f3b-8142-2a28f93e616f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:51.463902 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869d3a8-b89b-4f3b-8142-2a28f93e616f None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:51.465330 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 377/765] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:51.470889 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb33a1-0a87-48d7-8e68-17d8df8a43e7 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:51.471408 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb33a1-0a87-48d7-8e68-17d8df8a43e7 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:51.471408 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb33a1-0a87-48d7-8e68-17d8df8a43e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:51.491926 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-accb33a1-0a87-48d7-8e68-17d8df8a43e7 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:51.493322 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-accb33a1-0a87-48d7-8e68-17d8df8a43e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:51.506976 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 389/766] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:35:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:51.845077 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869d3a8-b89b-4f3b-8142-2a28f93e616f None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:35:51.859449 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869d3a8-b89b-4f3b-8142-2a28f93e616f None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:35:51.864918 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b1525-caf6-4ece-b224-9bc7c329045d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:35:51.865517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b1525-caf6-4ece-b224-9bc7c329045d service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:51.865789 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b1525-caf6-4ece-b224-9bc7c329045d service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:51.866053 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b1525-caf6-4ece-b224-9bc7c329045d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:51.875480 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b1525-caf6-4ece-b224-9bc7c329045d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:35:51.877163 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b1525-caf6-4ece-b224-9bc7c329045d service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:35:51.886895 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 378/767] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:35:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:35:54.690933 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12941a-8567-4431-91d9-71273fab1582 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:54.691507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12941a-8567-4431-91d9-71273fab1582 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:54.691507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12941a-8567-4431-91d9-71273fab1582 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:54.693205 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 390/768] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:54.699362 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346479a-56fb-48c0-89db-294482a786fd None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:54.700236 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346479a-56fb-48c0-89db-294482a786fd None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:54.700704 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346479a-56fb-48c0-89db-294482a786fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:54.723166 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e346479a-56fb-48c0-89db-294482a786fd None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:54.724373 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e346479a-56fb-48c0-89db-294482a786fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:54.732809 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 379/769] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:35:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:55.080594 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fcfd6-d46c-4993-b627-5f127364242e None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:55.080894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fcfd6-d46c-4993-b627-5f127364242e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:55.081591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fcfd6-d46c-4993-b627-5f127364242e None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:55.082480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 391/770] 10.222.0.40 () {54 vars in 961 bytes} [Sat Oct 29 20:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:55.088273 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df00bd-8022-47de-b45e-f3fb8d288443 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:55.088737 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df00bd-8022-47de-b45e-f3fb8d288443 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:55.089014 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df00bd-8022-47de-b45e-f3fb8d288443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:55.114825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-50df00bd-8022-47de-b45e-f3fb8d288443 None None] MFA Rules not processed for user `b61b58116d364480aed22b5715f6a78a`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:55.116088 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-50df00bd-8022-47de-b45e-f3fb8d288443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:55.126755 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 380/771] 10.222.0.40 () {58 vars in 1058 bytes} [Sat Oct 29 20:35:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:55.137012 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fcfd6-d46c-4993-b627-5f127364242e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:35:55.155416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fcfd6-d46c-4993-b627-5f127364242e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:35:55.160471 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7580e-2160-4884-b13f-e9f1ba5f9f93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:35:55.161282 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7580e-2160-4884-b13f-e9f1ba5f9f93 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:55.161706 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7580e-2160-4884-b13f-e9f1ba5f9f93 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:55.162124 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7580e-2160-4884-b13f-e9f1ba5f9f93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:55.171781 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7580e-2160-4884-b13f-e9f1ba5f9f93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:35:55.173631 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7580e-2160-4884-b13f-e9f1ba5f9f93 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:35:55.191484 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 392/772] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:35:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:35:57.907762 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86708-ae98-4f95-9497-aefaaec10444 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:57.908310 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86708-ae98-4f95-9497-aefaaec10444 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:57.908310 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86708-ae98-4f95-9497-aefaaec10444 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:57.909753 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 381/773] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:57.915162 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b39089-212a-4bff-a760-ba2568c47b61 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:57.916014 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b39089-212a-4bff-a760-ba2568c47b61 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:57.917043 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b39089-212a-4bff-a760-ba2568c47b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:57.939489 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b2b39089-212a-4bff-a760-ba2568c47b61 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:57.941171 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b2b39089-212a-4bff-a760-ba2568c47b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:57.955752 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 393/774] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:35:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:35:58.459397 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a86708-ae98-4f95-9497-aefaaec10444 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:35:58.474221 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a86708-ae98-4f95-9497-aefaaec10444 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:35:58.480954 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869304d-51ad-41f1-a0ff-3916ae62eea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:35:58.481810 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869304d-51ad-41f1-a0ff-3916ae62eea7 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:58.482139 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869304d-51ad-41f1-a0ff-3916ae62eea7 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:58.482505 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869304d-51ad-41f1-a0ff-3916ae62eea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:58.495826 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869304d-51ad-41f1-a0ff-3916ae62eea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:35:58.497756 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869304d-51ad-41f1-a0ff-3916ae62eea7 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:35:58.521893 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 382/775] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:35:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:35:58.734186 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6313ec3-7a95-458c-bf53-750578c64453 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:58.734466 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6313ec3-7a95-458c-bf53-750578c64453 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:58.734736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6313ec3-7a95-458c-bf53-750578c64453 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:58.736106 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 394/776] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:58.741696 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41093467-4877-46ea-8974-29715c08c3c0 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:58.742110 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41093467-4877-46ea-8974-29715c08c3c0 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:58.742481 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41093467-4877-46ea-8974-29715c08c3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:58.763709 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-41093467-4877-46ea-8974-29715c08c3c0 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:58.765073 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-41093467-4877-46ea-8974-29715c08c3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:58.773400 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 383/777] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:35:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:59.181744 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7cd7f-d939-4be2-bede-2748090f04e4 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:59.182124 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7cd7f-d939-4be2-bede-2748090f04e4 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:59.182352 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7cd7f-d939-4be2-bede-2748090f04e4 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:59.183903 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 395/778] 10.222.0.40 () {54 vars in 963 bytes} [Sat Oct 29 20:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:35:59.189037 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5df877-a691-46f0-9638-c43b97f35c77 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:59.189455 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5df877-a691-46f0-9638-c43b97f35c77 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:59.189657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5df877-a691-46f0-9638-c43b97f35c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:59.231037 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-1f5df877-a691-46f0-9638-c43b97f35c77 None None] MFA Rules not processed for user `2a21be7abe924b459ffe156f914e6ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:35:59.232265 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1f5df877-a691-46f0-9638-c43b97f35c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:35:59.303086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 384/779] 10.222.0.40 () {58 vars in 1060 bytes} [Sat Oct 29 20:35:59 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:35:59.311163 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7cd7f-d939-4be2-bede-2748090f04e4 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:35:59.322074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7cd7f-d939-4be2-bede-2748090f04e4 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:35:59.326286 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73317f03-ddc2-47d7-89a9-df657acc08f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a21be7abe924b459ffe156f914e6ff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:35:59.327115 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73317f03-ddc2-47d7-89a9-df657acc08f7 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:35:59.327434 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73317f03-ddc2-47d7-89a9-df657acc08f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:35:59.327709 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73317f03-ddc2-47d7-89a9-df657acc08f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:35:59.337311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73317f03-ddc2-47d7-89a9-df657acc08f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:35:59.339791 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73317f03-ddc2-47d7-89a9-df657acc08f7 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:35:59.350088 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 396/780] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:35:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:01.045370 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de0867-89a6-4f3a-bede-1b122ea9463d None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:01.045891 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de0867-89a6-4f3a-bede-1b122ea9463d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:01.045891 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de0867-89a6-4f3a-bede-1b122ea9463d None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:01.047231 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 385/781] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:01.052780 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553120a-8e4d-4d61-8d10-e6107878b0db None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:01.053184 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553120a-8e4d-4d61-8d10-e6107878b0db None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:01.053467 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553120a-8e4d-4d61-8d10-e6107878b0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:01.073175 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0553120a-8e4d-4d61-8d10-e6107878b0db None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:01.074357 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0553120a-8e4d-4d61-8d10-e6107878b0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:01.082335 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 397/782] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:36:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:36:01.433462 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de0867-89a6-4f3a-bede-1b122ea9463d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:01.447086 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de0867-89a6-4f3a-bede-1b122ea9463d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:01.452710 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0953e-6691-41f0-9d16-263dacc2f0d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:01.453305 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0953e-6691-41f0-9d16-263dacc2f0d1 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:01.453583 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0953e-6691-41f0-9d16-263dacc2f0d1 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:01.453855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0953e-6691-41f0-9d16-263dacc2f0d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:01.462222 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0953e-6691-41f0-9d16-263dacc2f0d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:01.464799 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0953e-6691-41f0-9d16-263dacc2f0d1 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:01.474244 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 386/783] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:03.966754 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f42253-da6f-4b1f-a0cc-635388319442 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:03.967270 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f42253-da6f-4b1f-a0cc-635388319442 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:03.967270 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f42253-da6f-4b1f-a0cc-635388319442 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:03.968649 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 398/784] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:03.974847 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993d896-e09a-4dd2-8008-e4187075c859 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:03.975289 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993d896-e09a-4dd2-8008-e4187075c859 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:03.975663 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993d896-e09a-4dd2-8008-e4187075c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:03.996936 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9993d896-e09a-4dd2-8008-e4187075c859 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:03.998099 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9993d896-e09a-4dd2-8008-e4187075c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:04.006613 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 387/785] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:36:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:04.349897 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f42253-da6f-4b1f-a0cc-635388319442 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:04.363789 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f42253-da6f-4b1f-a0cc-635388319442 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:04.368849 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863c466-9c68-47de-8add-468b299f8516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:04.371015 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863c466-9c68-47de-8add-468b299f8516 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:04.371330 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863c466-9c68-47de-8add-468b299f8516 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:04.371606 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863c466-9c68-47de-8add-468b299f8516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:04.380542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863c466-9c68-47de-8add-468b299f8516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:04.382142 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863c466-9c68-47de-8add-468b299f8516 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:04.393117 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 399/786] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:06.871336 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69168104-8aed-4268-88b2-f1efcfc258fe None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:06.871893 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69168104-8aed-4268-88b2-f1efcfc258fe None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:06.871893 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69168104-8aed-4268-88b2-f1efcfc258fe None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:06.873340 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 388/787] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:06.878696 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c9e8-84bf-43a7-b8c8-ee240da00904 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:06.879100 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c9e8-84bf-43a7-b8c8-ee240da00904 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:06.879236 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c9e8-84bf-43a7-b8c8-ee240da00904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:06.903602 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-76d8c9e8-84bf-43a7-b8c8-ee240da00904 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:06.904951 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-76d8c9e8-84bf-43a7-b8c8-ee240da00904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:06.922701 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 400/788] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:36:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:07.259899 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69168104-8aed-4268-88b2-f1efcfc258fe None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:07.274589 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69168104-8aed-4268-88b2-f1efcfc258fe None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:07.280431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211cdf9-34ea-4715-a09b-37ede732d603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:07.281236 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211cdf9-34ea-4715-a09b-37ede732d603 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:07.281691 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211cdf9-34ea-4715-a09b-37ede732d603 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:07.282152 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211cdf9-34ea-4715-a09b-37ede732d603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:07.290558 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211cdf9-34ea-4715-a09b-37ede732d603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:07.293052 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211cdf9-34ea-4715-a09b-37ede732d603 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:07.302880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 389/789] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:09.979437 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4e4d2-e4a4-4b99-9919-179f35f3d70f None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:09.980604 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4e4d2-e4a4-4b99-9919-179f35f3d70f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:09.980604 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4e4d2-e4a4-4b99-9919-179f35f3d70f None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:09.981275 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 401/790] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:09.987209 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e55ca-0c76-4b35-8d6c-2317a0601937 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:09.987738 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e55ca-0c76-4b35-8d6c-2317a0601937 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:09.988008 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e55ca-0c76-4b35-8d6c-2317a0601937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:10.011907 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e09e55ca-0c76-4b35-8d6c-2317a0601937 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:10.013109 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e09e55ca-0c76-4b35-8d6c-2317a0601937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:10.021054 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 390/791] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:36:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:10.578067 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4e4d2-e4a4-4b99-9919-179f35f3d70f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:10.593908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4e4d2-e4a4-4b99-9919-179f35f3d70f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:10.599472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc0658-a48a-4968-88ee-12f9a531d4ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:10.599999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc0658-a48a-4968-88ee-12f9a531d4ad service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:10.600294 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc0658-a48a-4968-88ee-12f9a531d4ad service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:10.600539 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc0658-a48a-4968-88ee-12f9a531d4ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:10.610102 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc0658-a48a-4968-88ee-12f9a531d4ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:10.611941 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc0658-a48a-4968-88ee-12f9a531d4ad service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:10.623541 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 402/792] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:13.564114 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816c40-dd42-4753-b81a-a311d4a878e7 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:13.564729 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816c40-dd42-4753-b81a-a311d4a878e7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:13.564729 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816c40-dd42-4753-b81a-a311d4a878e7 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:13.565948 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 391/793] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:13.571102 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04663a-455f-443a-92ee-69d30477441f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:13.571597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04663a-455f-443a-92ee-69d30477441f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:13.571739 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04663a-455f-443a-92ee-69d30477441f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:13.579545 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=43 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:36:13.593174 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-3b04663a-455f-443a-92ee-69d30477441f None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:13.594620 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3b04663a-455f-443a-92ee-69d30477441f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:13.602577 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 403/794] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:36:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:13.971547 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24816c40-dd42-4753-b81a-a311d4a878e7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:13.984859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24816c40-dd42-4753-b81a-a311d4a878e7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:13.989705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8df7c1-6c8a-46d5-a832-bc9db2ec3b5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:13.990288 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df7c1-6c8a-46d5-a832-bc9db2ec3b5d service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:13.990562 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df7c1-6c8a-46d5-a832-bc9db2ec3b5d service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:13.990833 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df7c1-6c8a-46d5-a832-bc9db2ec3b5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:13.999389 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8df7c1-6c8a-46d5-a832-bc9db2ec3b5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:14.000995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8df7c1-6c8a-46d5-a832-bc9db2ec3b5d service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:14.010892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 392/795] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:15.568669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1946-b767-4736-8d8a-d5e722936edb None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:15.569205 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1946-b767-4736-8d8a-d5e722936edb None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:15.569205 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1946-b767-4736-8d8a-d5e722936edb None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:15.570483 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 404/796] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:15.576470 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e08786-024c-44b1-b24e-f688d58b249c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:15.576928 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e08786-024c-44b1-b24e-f688d58b249c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:15.577035 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e08786-024c-44b1-b24e-f688d58b249c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:15.595821 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-35e08786-024c-44b1-b24e-f688d58b249c None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:15.597004 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-35e08786-024c-44b1-b24e-f688d58b249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:15.604919 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 393/797] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:36:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:36:15.963921 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b6a94-c6fe-4502-8641-f6e1f4688a43 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:15.964242 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b6a94-c6fe-4502-8641-f6e1f4688a43 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:15.964470 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b6a94-c6fe-4502-8641-f6e1f4688a43 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:15.965946 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 405/798] 10.222.0.40 () {54 vars in 962 bytes} [Sat Oct 29 20:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:15.971567 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953f41-96c3-4f1c-ab9a-eb3a04e56ec2 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:15.971916 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953f41-96c3-4f1c-ab9a-eb3a04e56ec2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:15.972250 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953f41-96c3-4f1c-ab9a-eb3a04e56ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:16.011602 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-7b953f41-96c3-4f1c-ab9a-eb3a04e56ec2 None None] MFA Rules not processed for user `d3f642ae91e04903ba8bba1eb8a1cea6`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:16.012772 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7b953f41-96c3-4f1c-ab9a-eb3a04e56ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:16.033793 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:36:16.078400 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 394/799] 10.222.0.40 () {58 vars in 1059 bytes} [Sat Oct 29 20:36:15 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:16.086025 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b6a94-c6fe-4502-8641-f6e1f4688a43 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:16.097930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b6a94-c6fe-4502-8641-f6e1f4688a43 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:16.101436 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db1bb8-c92d-4409-ae72-1666bcea9c14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3f642ae91e04903ba8bba1eb8a1cea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:16.102024 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db1bb8-c92d-4409-ae72-1666bcea9c14 service glance] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:16.102296 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db1bb8-c92d-4409-ae72-1666bcea9c14 service glance] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:16.102563 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db1bb8-c92d-4409-ae72-1666bcea9c14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:16.112182 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db1bb8-c92d-4409-ae72-1666bcea9c14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:16.113608 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db1bb8-c92d-4409-ae72-1666bcea9c14 service glance] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:16.123374 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 406/800] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:16.474417 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8566df-94f8-45b8-846a-090433132ae1 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:16.474751 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8566df-94f8-45b8-846a-090433132ae1 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:16.475055 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8566df-94f8-45b8-846a-090433132ae1 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:16.476409 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 395/801] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:16.482144 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b79037-b1f0-4192-ad23-10475f7e1429 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:16.482429 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b79037-b1f0-4192-ad23-10475f7e1429 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:16.482713 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b79037-b1f0-4192-ad23-10475f7e1429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:16.503563 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-e0b79037-b1f0-4192-ad23-10475f7e1429 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:16.504657 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e0b79037-b1f0-4192-ad23-10475f7e1429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:16.512386 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 407/802] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:36:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:16.860749 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8566df-94f8-45b8-846a-090433132ae1 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:16.881347 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8566df-94f8-45b8-846a-090433132ae1 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:16.890159 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339a1f4-6bc5-40d9-a917-11954bda2f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:16.890770 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a1f4-6bc5-40d9-a917-11954bda2f70 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:16.891143 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a1f4-6bc5-40d9-a917-11954bda2f70 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:16.891371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a1f4-6bc5-40d9-a917-11954bda2f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:16.900035 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339a1f4-6bc5-40d9-a917-11954bda2f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:16.901945 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339a1f4-6bc5-40d9-a917-11954bda2f70 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:16.912270 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 396/803] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:19.492559 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56c386-b03c-40f1-bf75-16ba6f1d9ab5 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:19.493170 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56c386-b03c-40f1-bf75-16ba6f1d9ab5 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:19.493170 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56c386-b03c-40f1-bf75-16ba6f1d9ab5 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:19.495075 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 408/804] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:19.500548 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182f78-7a34-4ed1-bcf6-39a9f0c4563c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:19.501101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182f78-7a34-4ed1-bcf6-39a9f0c4563c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:19.501101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182f78-7a34-4ed1-bcf6-39a9f0c4563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:19.521026 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-3a182f78-7a34-4ed1-bcf6-39a9f0c4563c None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:19.522247 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3a182f78-7a34-4ed1-bcf6-39a9f0c4563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:19.530108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 397/805] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:36:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:19.890232 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56c386-b03c-40f1-bf75-16ba6f1d9ab5 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:19.906868 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56c386-b03c-40f1-bf75-16ba6f1d9ab5 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:19.911885 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e08ff-0ad5-4754-b530-c110c5edf872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:19.914752 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e08ff-0ad5-4754-b530-c110c5edf872 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:19.914752 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e08ff-0ad5-4754-b530-c110c5edf872 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:19.914752 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e08ff-0ad5-4754-b530-c110c5edf872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:19.924602 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e08ff-0ad5-4754-b530-c110c5edf872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:19.926249 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e08ff-0ad5-4754-b530-c110c5edf872 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:19.936650 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 409/806] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:22.539932 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915504e5-6a4f-4fe4-8a0c-8de03af0200d None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:22.540509 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915504e5-6a4f-4fe4-8a0c-8de03af0200d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:22.540509 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915504e5-6a4f-4fe4-8a0c-8de03af0200d None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:22.542515 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 398/807] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:36:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:22.547805 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dcb75-e731-48ab-a831-fc442a0d4ef0 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:22.551784 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dcb75-e731-48ab-a831-fc442a0d4ef0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:22.551784 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dcb75-e731-48ab-a831-fc442a0d4ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:22.569727 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-da3dcb75-e731-48ab-a831-fc442a0d4ef0 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:22.571549 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-da3dcb75-e731-48ab-a831-fc442a0d4ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:22.579867 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 410/808] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:36:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:22.926992 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915504e5-6a4f-4fe4-8a0c-8de03af0200d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:22.940765 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915504e5-6a4f-4fe4-8a0c-8de03af0200d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:22.945650 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49925b-997f-4343-90e8-47e5e0523605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:22.946275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49925b-997f-4343-90e8-47e5e0523605 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:22.946550 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49925b-997f-4343-90e8-47e5e0523605 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:22.946818 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49925b-997f-4343-90e8-47e5e0523605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:22.955573 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49925b-997f-4343-90e8-47e5e0523605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:22.957173 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49925b-997f-4343-90e8-47e5e0523605 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:22.968055 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 399/809] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:31.602741 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d1583-8883-443e-96d6-6ef3047cbdb1 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:31.603878 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d1583-8883-443e-96d6-6ef3047cbdb1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:31.603878 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d1583-8883-443e-96d6-6ef3047cbdb1 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:31.605061 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 411/810] 10.222.0.40 () {54 vars in 918 bytes} [Sat Oct 29 20:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:31.610077 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda431b-9fde-400f-ac2e-a13941a3bb62 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:31.610544 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda431b-9fde-400f-ac2e-a13941a3bb62 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:31.610639 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda431b-9fde-400f-ac2e-a13941a3bb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:31.630924 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-7cda431b-9fde-400f-ac2e-a13941a3bb62 None None] MFA Rules not processed for user `d70c0c1dd66244b68052c278d9b39dce`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:31.632164 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7cda431b-9fde-400f-ac2e-a13941a3bb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:31.640843 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 400/811] 10.222.0.40 () {58 vars in 1015 bytes} [Sat Oct 29 20:36:31 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:31.654981 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689c1ad-7cf4-4f0d-8bed-71b7a0aafb58 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:31.655282 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689c1ad-7cf4-4f0d-8bed-71b7a0aafb58 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:31.655580 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689c1ad-7cf4-4f0d-8bed-71b7a0aafb58 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:31.656881 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 412/812] 10.222.0.40 () {54 vars in 918 bytes} [Sat Oct 29 20:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:31.661334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199e61b-a11c-4c10-8e04-4813406f13b4 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:31.661609 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199e61b-a11c-4c10-8e04-4813406f13b4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:31.661879 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199e61b-a11c-4c10-8e04-4813406f13b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:31.683420 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-d199e61b-a11c-4c10-8e04-4813406f13b4 None None] MFA Rules not processed for user `b61b58116d364480aed22b5715f6a78a`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:31.684599 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d199e61b-a11c-4c10-8e04-4813406f13b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:31.693017 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 401/813] 10.222.0.40 () {58 vars in 1015 bytes} [Sat Oct 29 20:36:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:32.564816 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=20 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:36:34.523756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330e433-cbc7-4260-945c-4a80967d39d8 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:34.524422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330e433-cbc7-4260-945c-4a80967d39d8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:34.524422 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330e433-cbc7-4260-945c-4a80967d39d8 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:34.526350 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 413/814] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:36:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:34.531862 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1704fe-e5fe-454d-8afd-1c8b7efd5a1f None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:34.532260 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1704fe-e5fe-454d-8afd-1c8b7efd5a1f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:34.532403 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1704fe-e5fe-454d-8afd-1c8b7efd5a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:34.552101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-de1704fe-e5fe-454d-8afd-1c8b7efd5a1f None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:34.553284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-de1704fe-e5fe-454d-8afd-1c8b7efd5a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:34.561297 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 402/815] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:36:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:34.904401 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330e433-cbc7-4260-945c-4a80967d39d8 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:34.918277 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330e433-cbc7-4260-945c-4a80967d39d8 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:34.923024 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c36e30-731a-45e7-be5e-1d1fd801b2eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:34.923898 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c36e30-731a-45e7-be5e-1d1fd801b2eb service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:34.924168 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c36e30-731a-45e7-be5e-1d1fd801b2eb service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:34.924427 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c36e30-731a-45e7-be5e-1d1fd801b2eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:34.932936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c36e30-731a-45e7-be5e-1d1fd801b2eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:34.934498 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c36e30-731a-45e7-be5e-1d1fd801b2eb service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:34.943595 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 414/816] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:36.675101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6437f3-b0e4-4df0-b1e1-e58bc1b978bf None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:36.675681 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6437f3-b0e4-4df0-b1e1-e58bc1b978bf None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:36.675681 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6437f3-b0e4-4df0-b1e1-e58bc1b978bf None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:36.677037 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 403/817] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 20:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:36.681975 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8919-84c6-4854-8f17-971475feccf8 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:36.682409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8919-84c6-4854-8f17-971475feccf8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:36.682521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8919-84c6-4854-8f17-971475feccf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:36.702087 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c4ef8919-84c6-4854-8f17-971475feccf8 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:36.703250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c4ef8919-84c6-4854-8f17-971475feccf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:36.710843 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 415/818] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 20:36:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:36.931268 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6437f3-b0e4-4df0-b1e1-e58bc1b978bf None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:36.946462 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6437f3-b0e4-4df0-b1e1-e58bc1b978bf None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:36.951651 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be3e4a-7298-4e30-bdd3-76a1494c3b9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:36.952244 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be3e4a-7298-4e30-bdd3-76a1494c3b9b service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:36.952543 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be3e4a-7298-4e30-bdd3-76a1494c3b9b service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:36.952814 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be3e4a-7298-4e30-bdd3-76a1494c3b9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:36.961051 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be3e4a-7298-4e30-bdd3-76a1494c3b9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:36.962792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be3e4a-7298-4e30-bdd3-76a1494c3b9b service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:36.972287 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 404/819] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:38.710698 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977005e-f092-4c0e-a06a-054ae8ef2a8d None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:38.711233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977005e-f092-4c0e-a06a-054ae8ef2a8d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:38.711233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977005e-f092-4c0e-a06a-054ae8ef2a8d None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:38.713144 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 416/820] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 20:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:38.718072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659a501-bc95-4bcb-9f4f-8828d426dc60 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:38.718497 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659a501-bc95-4bcb-9f4f-8828d426dc60 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:38.718604 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659a501-bc95-4bcb-9f4f-8828d426dc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:38.738596 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c659a501-bc95-4bcb-9f4f-8828d426dc60 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:38.739810 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c659a501-bc95-4bcb-9f4f-8828d426dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:38.747782 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 405/821] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 20:36:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:38.904878 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977005e-f092-4c0e-a06a-054ae8ef2a8d None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:38.918362 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977005e-f092-4c0e-a06a-054ae8ef2a8d None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:38.923244 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93b902-4d95-4b79-82eb-2a8357cd6f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:38.924112 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93b902-4d95-4b79-82eb-2a8357cd6f85 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:38.924383 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93b902-4d95-4b79-82eb-2a8357cd6f85 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:38.924649 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93b902-4d95-4b79-82eb-2a8357cd6f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:38.933152 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93b902-4d95-4b79-82eb-2a8357cd6f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:38.934731 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93b902-4d95-4b79-82eb-2a8357cd6f85 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:38.943817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 417/822] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:40.598050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee151-841b-4d7e-8e84-99fbbc900bd9 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:40.598592 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee151-841b-4d7e-8e84-99fbbc900bd9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:40.598592 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee151-841b-4d7e-8e84-99fbbc900bd9 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:40.599947 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 406/823] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 20:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:40.604996 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02a28d-8b7e-4092-bd33-05d88a846b4b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:40.605409 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02a28d-8b7e-4092-bd33-05d88a846b4b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:40.605528 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02a28d-8b7e-4092-bd33-05d88a846b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:40.624759 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9e02a28d-8b7e-4092-bd33-05d88a846b4b None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:40.625931 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9e02a28d-8b7e-4092-bd33-05d88a846b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:40.633656 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 418/824] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 20:36:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:40.788960 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ee151-841b-4d7e-8e84-99fbbc900bd9 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:40.803530 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ee151-841b-4d7e-8e84-99fbbc900bd9 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:40.812697 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b18fe-f00b-4ab5-b49b-38f78f2d7bb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:40.813316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b18fe-f00b-4ab5-b49b-38f78f2d7bb0 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:40.813589 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b18fe-f00b-4ab5-b49b-38f78f2d7bb0 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:40.813857 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b18fe-f00b-4ab5-b49b-38f78f2d7bb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:40.823319 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b18fe-f00b-4ab5-b49b-38f78f2d7bb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:40.826663 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b18fe-f00b-4ab5-b49b-38f78f2d7bb0 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:40.835846 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 407/825] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:42.495905 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf1412-4ec9-41af-a2ef-3f3f88316cf3 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:42.496431 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf1412-4ec9-41af-a2ef-3f3f88316cf3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:42.496548 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf1412-4ec9-41af-a2ef-3f3f88316cf3 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:42.497814 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 419/826] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 20:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:36:42.502584 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3f20b-6fff-4da5-a3f9-51205f4ab0a0 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:42.502975 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3f20b-6fff-4da5-a3f9-51205f4ab0a0 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:42.503066 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3f20b-6fff-4da5-a3f9-51205f4ab0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:42.522759 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-05c3f20b-6fff-4da5-a3f9-51205f4ab0a0 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:42.523965 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-05c3f20b-6fff-4da5-a3f9-51205f4ab0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:42.531715 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 408/827] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 20:36:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:42.688465 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf1412-4ec9-41af-a2ef-3f3f88316cf3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:42.702188 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf1412-4ec9-41af-a2ef-3f3f88316cf3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:42.706991 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be55ac-35b6-43dd-8159-b1546e3e11e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:42.707604 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be55ac-35b6-43dd-8159-b1546e3e11e7 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:42.707878 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be55ac-35b6-43dd-8159-b1546e3e11e7 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:42.708140 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be55ac-35b6-43dd-8159-b1546e3e11e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:42.716393 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be55ac-35b6-43dd-8159-b1546e3e11e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:42.717958 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be55ac-35b6-43dd-8159-b1546e3e11e7 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:42.727067 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 420/828] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:44.341488 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db24079-c15e-462a-888d-693e0144dd11 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:44.342062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db24079-c15e-462a-888d-693e0144dd11 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:44.342062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db24079-c15e-462a-888d-693e0144dd11 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:44.343367 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 409/829] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 20:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:44.348331 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acbb7c-99bc-489e-b9bf-421ddebcf0ea None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:44.348750 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acbb7c-99bc-489e-b9bf-421ddebcf0ea None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:44.348878 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acbb7c-99bc-489e-b9bf-421ddebcf0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:44.368557 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a6acbb7c-99bc-489e-b9bf-421ddebcf0ea None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:44.370337 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a6acbb7c-99bc-489e-b9bf-421ddebcf0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:44.378080 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 421/830] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 20:36:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:44.534390 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db24079-c15e-462a-888d-693e0144dd11 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:44.548172 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db24079-c15e-462a-888d-693e0144dd11 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:44.553316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e89228-aae5-4a44-b78b-323256383f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:44.553898 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e89228-aae5-4a44-b78b-323256383f45 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:44.554170 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e89228-aae5-4a44-b78b-323256383f45 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:44.554434 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e89228-aae5-4a44-b78b-323256383f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:44.563221 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e89228-aae5-4a44-b78b-323256383f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:44.564845 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e89228-aae5-4a44-b78b-323256383f45 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:44.574324 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 410/831] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:46.171468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d940916-7d6f-447b-988a-f6136bc9dde0 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:46.172054 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d940916-7d6f-447b-988a-f6136bc9dde0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:46.172054 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d940916-7d6f-447b-988a-f6136bc9dde0 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:46.173346 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 422/832] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 20:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:46.178367 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450fa56-bed2-4699-8f0a-cc369bd3dfa2 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:46.178796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450fa56-bed2-4699-8f0a-cc369bd3dfa2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:46.178899 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450fa56-bed2-4699-8f0a-cc369bd3dfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:46.187533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=64 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:36:46.201076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0450fa56-bed2-4699-8f0a-cc369bd3dfa2 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:46.202248 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0450fa56-bed2-4699-8f0a-cc369bd3dfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:46.209912 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 411/833] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 20:36:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:46.367987 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d940916-7d6f-447b-988a-f6136bc9dde0 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:46.381892 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d940916-7d6f-447b-988a-f6136bc9dde0 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:46.387555 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12e23a-9527-40f1-a762-f927c398eb9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:46.388148 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12e23a-9527-40f1-a762-f927c398eb9a service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:46.388423 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12e23a-9527-40f1-a762-f927c398eb9a service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:46.388691 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12e23a-9527-40f1-a762-f927c398eb9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:46.396715 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12e23a-9527-40f1-a762-f927c398eb9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:46.398286 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12e23a-9527-40f1-a762-f927c398eb9a service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:46.407600 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 423/834] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:48.005451 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b50c8e-86d9-421d-891b-f0cc9e796fe7 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:48.005985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b50c8e-86d9-421d-891b-f0cc9e796fe7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:48.005985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b50c8e-86d9-421d-891b-f0cc9e796fe7 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:48.007287 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 412/835] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 20:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:48.012085 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deded1da-704b-450a-823a-b75f5a1a83fc None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:48.012484 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deded1da-704b-450a-823a-b75f5a1a83fc None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:48.012638 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deded1da-704b-450a-823a-b75f5a1a83fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:48.032424 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-deded1da-704b-450a-823a-b75f5a1a83fc None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:48.033611 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-deded1da-704b-450a-823a-b75f5a1a83fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:48.041968 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 424/836] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 20:36:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:48.201546 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b50c8e-86d9-421d-891b-f0cc9e796fe7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:48.214820 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b50c8e-86d9-421d-891b-f0cc9e796fe7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:48.220325 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aa27e-c4aa-49aa-9bb8-cf06e610bb65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:48.220910 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aa27e-c4aa-49aa-9bb8-cf06e610bb65 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:48.221184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aa27e-c4aa-49aa-9bb8-cf06e610bb65 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:48.221452 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aa27e-c4aa-49aa-9bb8-cf06e610bb65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:48.230494 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860aa27e-c4aa-49aa-9bb8-cf06e610bb65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:48.232121 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860aa27e-c4aa-49aa-9bb8-cf06e610bb65 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:48.241657 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 413/837] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:49.944823 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640e65e-2915-4701-bd0e-0409498068ad None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:49.945383 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640e65e-2915-4701-bd0e-0409498068ad None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:49.945383 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640e65e-2915-4701-bd0e-0409498068ad None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:49.947428 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 425/838] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 20:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:49.952466 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792d7ea-4311-4a4d-90ab-6dce46a06f68 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:49.952897 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792d7ea-4311-4a4d-90ab-6dce46a06f68 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:49.953004 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792d7ea-4311-4a4d-90ab-6dce46a06f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:49.972974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f792d7ea-4311-4a4d-90ab-6dce46a06f68 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:49.974139 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f792d7ea-4311-4a4d-90ab-6dce46a06f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:49.981836 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 414/839] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 20:36:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:50.138708 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640e65e-2915-4701-bd0e-0409498068ad None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:50.152613 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640e65e-2915-4701-bd0e-0409498068ad None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:50.157595 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d97312-6e32-4522-b374-cda8271f1123 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:50.158196 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d97312-6e32-4522-b374-cda8271f1123 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:50.158463 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d97312-6e32-4522-b374-cda8271f1123 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:50.158736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d97312-6e32-4522-b374-cda8271f1123 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:50.167336 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d97312-6e32-4522-b374-cda8271f1123 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:50.168910 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d97312-6e32-4522-b374-cda8271f1123 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:50.178332 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 426/840] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:52.494649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf8281-bea1-43c3-ae1c-51f56725e2c4 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:52.495185 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf8281-bea1-43c3-ae1c-51f56725e2c4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:52.495185 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf8281-bea1-43c3-ae1c-51f56725e2c4 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:52.496520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 415/841] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:52.501707 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a869fe4-4d96-405a-aaa9-8f87902435b1 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:52.502139 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a869fe4-4d96-405a-aaa9-8f87902435b1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:52.502243 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a869fe4-4d96-405a-aaa9-8f87902435b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:52.521647 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8a869fe4-4d96-405a-aaa9-8f87902435b1 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:52.522835 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8a869fe4-4d96-405a-aaa9-8f87902435b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:52.531250 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 427/842] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:36:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:52.864855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf8281-bea1-43c3-ae1c-51f56725e2c4 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:52.875647 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf8281-bea1-43c3-ae1c-51f56725e2c4 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:52.879056 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b37e-5731-4919-a598-693c89613b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:52.879703 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b37e-5731-4919-a598-693c89613b25 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:52.879977 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b37e-5731-4919-a598-693c89613b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:52.880239 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b37e-5731-4919-a598-693c89613b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:52.888870 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043b37e-5731-4919-a598-693c89613b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:52.890280 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043b37e-5731-4919-a598-693c89613b25 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:52.899344 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 416/843] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:55.446919 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd58644-3614-49bb-8e1f-0ed3f4e40163 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:55.447490 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd58644-3614-49bb-8e1f-0ed3f4e40163 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:55.447490 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd58644-3614-49bb-8e1f-0ed3f4e40163 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:55.448833 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 428/844] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:55.454041 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a769a4-58e9-4376-a237-36e6312bd7d7 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:55.454482 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a769a4-58e9-4376-a237-36e6312bd7d7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:55.454667 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a769a4-58e9-4376-a237-36e6312bd7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:55.473634 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f0a769a4-58e9-4376-a237-36e6312bd7d7 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:55.474817 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f0a769a4-58e9-4376-a237-36e6312bd7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:55.483061 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 417/845] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:36:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:55.821448 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd58644-3614-49bb-8e1f-0ed3f4e40163 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:55.832356 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd58644-3614-49bb-8e1f-0ed3f4e40163 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:55.835778 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee3a64-1f7e-458a-a843-756194f7fa88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:55.836360 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee3a64-1f7e-458a-a843-756194f7fa88 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:55.836632 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee3a64-1f7e-458a-a843-756194f7fa88 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:55.836897 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee3a64-1f7e-458a-a843-756194f7fa88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:55.846182 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee3a64-1f7e-458a-a843-756194f7fa88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:55.847638 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee3a64-1f7e-458a-a843-756194f7fa88 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:55.857736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 429/846] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:36:58.608194 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a2bb8-2a0c-4c03-ba05-f46251112077 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:58.608753 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a2bb8-2a0c-4c03-ba05-f46251112077 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:58.608753 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a2bb8-2a0c-4c03-ba05-f46251112077 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:58.610066 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 418/847] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:36:58.615225 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9d638-9bb2-4b60-bc5d-e2194e61ad03 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:58.615629 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9d638-9bb2-4b60-bc5d-e2194e61ad03 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:58.615849 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9d638-9bb2-4b60-bc5d-e2194e61ad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:58.635844 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-e5a9d638-9bb2-4b60-bc5d-e2194e61ad03 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:36:58.637037 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e5a9d638-9bb2-4b60-bc5d-e2194e61ad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:36:58.644771 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 430/848] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:36:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:36:58.990394 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a2bb8-2a0c-4c03-ba05-f46251112077 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:36:59.001724 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a2bb8-2a0c-4c03-ba05-f46251112077 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:36:59.005111 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bca51-4705-434d-9f41-17003003c46a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:36:59.005691 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bca51-4705-434d-9f41-17003003c46a service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:36:59.005963 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bca51-4705-434d-9f41-17003003c46a service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:36:59.006225 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bca51-4705-434d-9f41-17003003c46a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:36:59.015545 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bca51-4705-434d-9f41-17003003c46a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:36:59.016980 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bca51-4705-434d-9f41-17003003c46a service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:36:59.026066 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 419/849] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:36:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:37:01.573796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf25a3f-0f51-4d3a-8c3c-1271c6a9a730 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:01.574317 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf25a3f-0f51-4d3a-8c3c-1271c6a9a730 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:01.574317 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf25a3f-0f51-4d3a-8c3c-1271c6a9a730 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:01.575656 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 431/850] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:37:01.580980 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f160e-ef4a-4e31-abb4-61744a2dacab None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:01.581407 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f160e-ef4a-4e31-abb4-61744a2dacab None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:01.581510 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f160e-ef4a-4e31-abb4-61744a2dacab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:01.601294 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-089f160e-ef4a-4e31-abb4-61744a2dacab None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:37:01.602470 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-089f160e-ef4a-4e31-abb4-61744a2dacab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:37:01.611328 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 420/851] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:37:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:37:01.965879 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf25a3f-0f51-4d3a-8c3c-1271c6a9a730 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:37:01.976622 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf25a3f-0f51-4d3a-8c3c-1271c6a9a730 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:37:01.980982 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c8704-7757-49c2-91c5-ce199f16ea59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:37:01.981570 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c8704-7757-49c2-91c5-ce199f16ea59 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:01.981879 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c8704-7757-49c2-91c5-ce199f16ea59 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:01.982160 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c8704-7757-49c2-91c5-ce199f16ea59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:01.990890 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c8704-7757-49c2-91c5-ce199f16ea59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:37:01.992367 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c8704-7757-49c2-91c5-ce199f16ea59 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:37:02.001908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 432/852] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:37:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:37:04.501982 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bd61d-c6e7-488b-9b6c-52ce23b700d8 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:04.502508 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bd61d-c6e7-488b-9b6c-52ce23b700d8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:04.502508 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bd61d-c6e7-488b-9b6c-52ce23b700d8 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:04.503846 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 421/853] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:37:04.509678 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e938e-64fc-47ec-aa9b-6921d69a4b5b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:04.510083 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e938e-64fc-47ec-aa9b-6921d69a4b5b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:04.510211 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e938e-64fc-47ec-aa9b-6921d69a4b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:04.517484 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=61 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:37:04.530931 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-020e938e-64fc-47ec-aa9b-6921d69a4b5b None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:37:04.532137 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-020e938e-64fc-47ec-aa9b-6921d69a4b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:37:04.539758 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 433/854] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:37:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:37:04.880938 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bd61d-c6e7-488b-9b6c-52ce23b700d8 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:37:04.892255 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bd61d-c6e7-488b-9b6c-52ce23b700d8 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:37:04.895776 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86e581-2e72-4e7b-a1e6-0851270e8286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:37:04.896357 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e581-2e72-4e7b-a1e6-0851270e8286 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:04.896633 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e581-2e72-4e7b-a1e6-0851270e8286 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:04.896902 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e581-2e72-4e7b-a1e6-0851270e8286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:04.905790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86e581-2e72-4e7b-a1e6-0851270e8286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:37:04.907206 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86e581-2e72-4e7b-a1e6-0851270e8286 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:37:04.916623 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 422/855] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:37:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:37:07.381193 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0febe92-c6fb-4217-94cf-52b23e600883 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:07.381736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0febe92-c6fb-4217-94cf-52b23e600883 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:07.381736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0febe92-c6fb-4217-94cf-52b23e600883 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:07.383050 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 434/856] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:37:07.388368 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3414c8-ebb1-49e0-865d-88d77c8ae097 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:07.388810 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3414c8-ebb1-49e0-865d-88d77c8ae097 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:07.388906 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3414c8-ebb1-49e0-865d-88d77c8ae097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:07.408703 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-3e3414c8-ebb1-49e0-865d-88d77c8ae097 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:37:07.409863 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3e3414c8-ebb1-49e0-865d-88d77c8ae097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:37:07.418311 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 423/857] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:37:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:37:07.751788 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0febe92-c6fb-4217-94cf-52b23e600883 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:37:07.763032 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0febe92-c6fb-4217-94cf-52b23e600883 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:37:07.766486 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38ba5a-0576-4399-92a4-590bf09c4ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:37:07.767070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38ba5a-0576-4399-92a4-590bf09c4ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:07.767378 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38ba5a-0576-4399-92a4-590bf09c4ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:07.767649 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38ba5a-0576-4399-92a4-590bf09c4ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:07.777206 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38ba5a-0576-4399-92a4-590bf09c4ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:37:07.778669 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38ba5a-0576-4399-92a4-590bf09c4ce3 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:37:07.787782 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 435/858] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:37:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:37:10.232814 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8fb1-5049-429c-a63e-bcda8969f774 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:10.233378 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8fb1-5049-429c-a63e-bcda8969f774 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:10.233378 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8fb1-5049-429c-a63e-bcda8969f774 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:10.234666 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 424/859] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:37:10.240064 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d56539-7f9f-49da-91dc-a8b564c5527c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:10.240499 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d56539-7f9f-49da-91dc-a8b564c5527c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:10.240643 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d56539-7f9f-49da-91dc-a8b564c5527c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:10.260058 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-39d56539-7f9f-49da-91dc-a8b564c5527c None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:37:10.261290 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-39d56539-7f9f-49da-91dc-a8b564c5527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:37:10.269031 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 436/860] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:37:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:37:10.606714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb8fb1-5049-429c-a63e-bcda8969f774 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:37:10.617223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb8fb1-5049-429c-a63e-bcda8969f774 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:37:10.621733 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a165134-d334-41dd-9c10-c715a9811828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:37:10.622314 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a165134-d334-41dd-9c10-c715a9811828 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:10.622583 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a165134-d334-41dd-9c10-c715a9811828 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:10.622846 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a165134-d334-41dd-9c10-c715a9811828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:10.631327 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a165134-d334-41dd-9c10-c715a9811828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:37:10.632742 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a165134-d334-41dd-9c10-c715a9811828 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:37:10.642857 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 425/861] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:37:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:37:13.085570 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356630e1-d12c-43fa-9fa4-5c6229a3071c None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:13.086098 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356630e1-d12c-43fa-9fa4-5c6229a3071c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:13.086098 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356630e1-d12c-43fa-9fa4-5c6229a3071c None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:13.088126 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 437/862] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:37:13.093288 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967fa84-ff89-4064-8b14-bbdf75675fc7 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:13.093685 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967fa84-ff89-4064-8b14-bbdf75675fc7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:13.093831 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967fa84-ff89-4064-8b14-bbdf75675fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:13.113184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-5967fa84-ff89-4064-8b14-bbdf75675fc7 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:37:13.114356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5967fa84-ff89-4064-8b14-bbdf75675fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:37:13.121985 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 426/863] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:37:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:37:13.466632 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356630e1-d12c-43fa-9fa4-5c6229a3071c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:37:13.477063 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356630e1-d12c-43fa-9fa4-5c6229a3071c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:37:13.481449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ca243-98b9-4a61-9271-f9b1fe19c5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:37:13.482029 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ca243-98b9-4a61-9271-f9b1fe19c5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:13.482393 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ca243-98b9-4a61-9271-f9b1fe19c5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:13.482665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ca243-98b9-4a61-9271-f9b1fe19c5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:13.491693 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ca243-98b9-4a61-9271-f9b1fe19c5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:37:13.494263 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ca243-98b9-4a61-9271-f9b1fe19c5a6 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:37:13.503333 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 438/864] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:37:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 20:37:15.910786 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235ea11-f3cf-4a4f-b42f-dbd093df259e None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:15.911416 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235ea11-f3cf-4a4f-b42f-dbd093df259e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:15.911416 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235ea11-f3cf-4a4f-b42f-dbd093df259e None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:15.912671 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 427/865] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:37:15.918432 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03538bad-f32b-4f20-9f70-56a5674705c6 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:15.918874 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03538bad-f32b-4f20-9f70-56a5674705c6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:15.918978 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03538bad-f32b-4f20-9f70-56a5674705c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:15.938964 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-03538bad-f32b-4f20-9f70-56a5674705c6 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:37:15.940175 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-03538bad-f32b-4f20-9f70-56a5674705c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:37:15.948242 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 439/866] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:37:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:37:16.286650 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235ea11-f3cf-4a4f-b42f-dbd093df259e None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:37:16.292072 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=48 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:37:16.298290 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235ea11-f3cf-4a4f-b42f-dbd093df259e None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:37:16.302018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3c030-f7d7-49f7-9459-f37768159e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:37:16.302600 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3c030-f7d7-49f7-9459-f37768159e45 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:16.302875 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3c030-f7d7-49f7-9459-f37768159e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:16.303144 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3c030-f7d7-49f7-9459-f37768159e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:16.312541 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3c030-f7d7-49f7-9459-f37768159e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:37:16.313955 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3c030-f7d7-49f7-9459-f37768159e45 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:37:16.323901 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 428/867] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:37:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:37:18.792346 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca7528-6b41-48f7-aa50-b5973bae47d5 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:18.792909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca7528-6b41-48f7-aa50-b5973bae47d5 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:18.792909 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca7528-6b41-48f7-aa50-b5973bae47d5 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:18.794230 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 440/868] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:37:18.799979 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870ed6c-294e-4fc7-9dd6-f6d0d8aa37ef None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:18.800392 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870ed6c-294e-4fc7-9dd6-f6d0d8aa37ef None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:18.800519 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870ed6c-294e-4fc7-9dd6-f6d0d8aa37ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:18.819608 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0870ed6c-294e-4fc7-9dd6-f6d0d8aa37ef None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:37:18.820792 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0870ed6c-294e-4fc7-9dd6-f6d0d8aa37ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:37:18.829100 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 429/869] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:37:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:37:19.172062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca7528-6b41-48f7-aa50-b5973bae47d5 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:37:19.183862 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca7528-6b41-48f7-aa50-b5973bae47d5 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:37:19.187282 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba6ff1-4722-48ef-a1d9-aeb61bd3eec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:37:19.187892 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba6ff1-4722-48ef-a1d9-aeb61bd3eec5 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:19.188165 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba6ff1-4722-48ef-a1d9-aeb61bd3eec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:19.188432 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba6ff1-4722-48ef-a1d9-aeb61bd3eec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:19.197968 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba6ff1-4722-48ef-a1d9-aeb61bd3eec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:37:19.199464 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba6ff1-4722-48ef-a1d9-aeb61bd3eec5 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:37:19.208798 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 441/870] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:37:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:37:28.814519 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=8 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:37:29.204721 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=26 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:37:44.012176 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f91c01-c6cc-4a9d-be6e-d3cfe8ad6ecd None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:44.012710 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f91c01-c6cc-4a9d-be6e-d3cfe8ad6ecd None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:44.012710 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f91c01-c6cc-4a9d-be6e-d3cfe8ad6ecd None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:44.014049 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 430/871] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:37:44.019255 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a30a4-bc62-4e7f-ae7c-2aef10102c86 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:44.019683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a30a4-bc62-4e7f-ae7c-2aef10102c86 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:44.019834 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a30a4-bc62-4e7f-ae7c-2aef10102c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:44.040743 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-775a30a4-bc62-4e7f-ae7c-2aef10102c86 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:37:44.041939 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-775a30a4-bc62-4e7f-ae7c-2aef10102c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:37:44.050009 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 442/872] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:37:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:37:44.402733 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56307238-5b98-4a97-b4e5-92b09d525424 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:44.403040 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56307238-5b98-4a97-b4e5-92b09d525424 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:44.403331 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56307238-5b98-4a97-b4e5-92b09d525424 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:44.404728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 431/873] 10.222.0.40 () {54 vars in 962 bytes} [Sat Oct 29 20:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:37:44.410140 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34998a-30f7-4178-87fb-4c47e6ef8bcb None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:44.410464 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34998a-30f7-4178-87fb-4c47e6ef8bcb None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:44.410801 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34998a-30f7-4178-87fb-4c47e6ef8bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:44.430468 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ba34998a-30f7-4178-87fb-4c47e6ef8bcb None None] MFA Rules not processed for user `d3f642ae91e04903ba8bba1eb8a1cea6`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:37:44.431683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ba34998a-30f7-4178-87fb-4c47e6ef8bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:37:44.438187 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 443/874] 10.222.0.40 () {58 vars in 1059 bytes} [Sat Oct 29 20:37:44 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:37:44.446233 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56307238-5b98-4a97-b4e5-92b09d525424 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:37:44.456708 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56307238-5b98-4a97-b4e5-92b09d525424 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:37:44.460171 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbbd7b-7dd4-4b8b-96a5-bc62bf70c464 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3f642ae91e04903ba8bba1eb8a1cea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:37:44.460747 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbd7b-7dd4-4b8b-96a5-bc62bf70c464 service glance] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:44.461834 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbd7b-7dd4-4b8b-96a5-bc62bf70c464 service glance] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:44.462155 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbd7b-7dd4-4b8b-96a5-bc62bf70c464 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:44.471117 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbbd7b-7dd4-4b8b-96a5-bc62bf70c464 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:37:44.472579 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbbd7b-7dd4-4b8b-96a5-bc62bf70c464 service glance] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:37:44.482007 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 432/875] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:37:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:37:46.951494 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e5607-9a05-4697-b97a-d4efa14b55ea None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:46.951955 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e5607-9a05-4697-b97a-d4efa14b55ea None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:46.952062 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e5607-9a05-4697-b97a-d4efa14b55ea None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:46.953372 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 444/876] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:37:46.958568 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30902342-1bd2-4ae8-a30c-489b63dc397a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:46.958980 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30902342-1bd2-4ae8-a30c-489b63dc397a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:46.959077 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30902342-1bd2-4ae8-a30c-489b63dc397a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:46.979136 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-30902342-1bd2-4ae8-a30c-489b63dc397a None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:37:46.980325 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-30902342-1bd2-4ae8-a30c-489b63dc397a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:37:46.987917 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 433/877] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:37:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:37:47.316451 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e5607-9a05-4697-b97a-d4efa14b55ea None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:37:47.329466 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e5607-9a05-4697-b97a-d4efa14b55ea None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:37:47.333870 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f79f8-3238-4bb9-baeb-9659860979c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:37:47.334459 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f79f8-3238-4bb9-baeb-9659860979c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:47.334733 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f79f8-3238-4bb9-baeb-9659860979c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:47.335002 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f79f8-3238-4bb9-baeb-9659860979c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:47.335682 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f79f8-3238-4bb9-baeb-9659860979c5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:37:47.337405 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: WARNING py.warnings [None req-6a7f79f8-3238-4bb9-baeb-9659860979c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:37:47.337405 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: warnings.warn(msg) Oct 29 20:37:47.337405 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: Oct 29 20:37:47.338550 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f79f8-3238-4bb9-baeb-9659860979c5 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:37:47.356078 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 445/878] 10.222.0.40 () {56 vars in 1108 bytes} [Sat Oct 29 20:37:47 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 20:37:49.762773 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73791d-053b-4e03-b609-add6047059ba None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:49.763367 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73791d-053b-4e03-b609-add6047059ba None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:49.763367 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73791d-053b-4e03-b609-add6047059ba None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:49.764632 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 434/879] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:37:49.769729 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569c95-d647-4f31-a38c-d499093fed14 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:49.770138 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569c95-d647-4f31-a38c-d499093fed14 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:49.770273 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569c95-d647-4f31-a38c-d499093fed14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:49.789822 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-d2569c95-d647-4f31-a38c-d499093fed14 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:37:49.790938 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d2569c95-d647-4f31-a38c-d499093fed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:37:49.798630 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 446/880] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:37:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:37:50.148174 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73791d-053b-4e03-b609-add6047059ba None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:37:50.162201 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73791d-053b-4e03-b609-add6047059ba None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:37:50.167911 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5837b-01eb-4fdb-9e8b-62eb68630e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:37:50.168491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5837b-01eb-4fdb-9e8b-62eb68630e8a service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:50.168762 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5837b-01eb-4fdb-9e8b-62eb68630e8a service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:50.169024 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5837b-01eb-4fdb-9e8b-62eb68630e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:50.177077 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5837b-01eb-4fdb-9e8b-62eb68630e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:37:50.178630 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5837b-01eb-4fdb-9e8b-62eb68630e8a service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:37:50.188107 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 435/881] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:37:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:37:52.794285 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240767-2b7b-4114-916e-8ad7cb720368 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:52.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240767-2b7b-4114-916e-8ad7cb720368 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:52.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240767-2b7b-4114-916e-8ad7cb720368 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:52.796177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 447/882] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:37:52.801567 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603d84e-1928-42bf-aa4b-049bde1bcac1 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:52.802010 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603d84e-1928-42bf-aa4b-049bde1bcac1 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:52.802123 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603d84e-1928-42bf-aa4b-049bde1bcac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:52.822050 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-d603d84e-1928-42bf-aa4b-049bde1bcac1 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:37:52.823256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d603d84e-1928-42bf-aa4b-049bde1bcac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:37:52.831644 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 436/883] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:37:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:37:53.174836 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240767-2b7b-4114-916e-8ad7cb720368 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:37:53.186545 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240767-2b7b-4114-916e-8ad7cb720368 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:37:53.189987 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252b0c5-11fb-48d2-b933-113ad88d72b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:37:53.190572 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252b0c5-11fb-48d2-b933-113ad88d72b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:53.190846 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252b0c5-11fb-48d2-b933-113ad88d72b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:53.191113 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252b0c5-11fb-48d2-b933-113ad88d72b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:53.200861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252b0c5-11fb-48d2-b933-113ad88d72b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:37:53.202410 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252b0c5-11fb-48d2-b933-113ad88d72b7 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:37:53.211759 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 448/884] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:37:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:37:55.678242 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2626b1-c078-46b5-97c5-5f5d627afc08 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:55.678793 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2626b1-c078-46b5-97c5-5f5d627afc08 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:55.678793 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2626b1-c078-46b5-97c5-5f5d627afc08 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:55.680225 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 437/885] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:37:55.685419 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece0a53-8769-4d75-a273-20aef9fc219a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:55.685823 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece0a53-8769-4d75-a273-20aef9fc219a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:55.685987 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece0a53-8769-4d75-a273-20aef9fc219a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:55.705688 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8ece0a53-8769-4d75-a273-20aef9fc219a None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:37:55.706852 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8ece0a53-8769-4d75-a273-20aef9fc219a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:37:55.715282 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 449/886] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:37:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:37:56.065353 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2626b1-c078-46b5-97c5-5f5d627afc08 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:37:56.076774 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2626b1-c078-46b5-97c5-5f5d627afc08 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:37:56.080367 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c7288-d111-46a7-979f-c10fbcce759a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:37:56.080960 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7288-d111-46a7-979f-c10fbcce759a service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:56.081232 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7288-d111-46a7-979f-c10fbcce759a service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:56.081496 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7288-d111-46a7-979f-c10fbcce759a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:56.090229 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c7288-d111-46a7-979f-c10fbcce759a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:37:56.091680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c7288-d111-46a7-979f-c10fbcce759a service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:37:56.100769 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 438/887] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:37:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:37:58.638207 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a5c9d-61b5-459b-ae6d-4e184641f27b None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:58.638753 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a5c9d-61b5-459b-ae6d-4e184641f27b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:58.638753 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a5c9d-61b5-459b-ae6d-4e184641f27b None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:58.640070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 450/888] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:37:58.645342 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa7279-c9f3-42b7-acfd-2e384454d5d8 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:58.645753 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa7279-c9f3-42b7-acfd-2e384454d5d8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:58.645885 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa7279-c9f3-42b7-acfd-2e384454d5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:58.665193 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-35fa7279-c9f3-42b7-acfd-2e384454d5d8 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:37:58.666376 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-35fa7279-c9f3-42b7-acfd-2e384454d5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:37:58.674416 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 439/889] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:37:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:37:59.018283 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a5c9d-61b5-459b-ae6d-4e184641f27b None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:37:59.029198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a5c9d-61b5-459b-ae6d-4e184641f27b None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:37:59.032637 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1c896-13d8-4b08-a4f6-459255754092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:37:59.033224 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1c896-13d8-4b08-a4f6-459255754092 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:37:59.033501 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1c896-13d8-4b08-a4f6-459255754092 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:37:59.033769 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1c896-13d8-4b08-a4f6-459255754092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:37:59.042613 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1c896-13d8-4b08-a4f6-459255754092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:37:59.044077 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1c896-13d8-4b08-a4f6-459255754092 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:37:59.053459 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 451/890] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:37:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:38:01.638892 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944a219-80d5-490c-b529-f9278c497fd6 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:38:01.639441 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944a219-80d5-490c-b529-f9278c497fd6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:38:01.639441 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944a219-80d5-490c-b529-f9278c497fd6 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:38:01.640712 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 440/891] 10.222.0.40 () {54 vars in 927 bytes} [Sat Oct 29 20:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:38:01.645997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60df083-0552-47e5-933a-6b49959108b3 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:38:01.646440 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60df083-0552-47e5-933a-6b49959108b3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:38:01.646572 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60df083-0552-47e5-933a-6b49959108b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:38:01.666305 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c60df083-0552-47e5-933a-6b49959108b3 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:38:01.667520 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c60df083-0552-47e5-933a-6b49959108b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:38:01.675612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 452/892] 10.222.0.40 () {58 vars in 1024 bytes} [Sat Oct 29 20:38:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:38:02.024386 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944a219-80d5-490c-b529-f9278c497fd6 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:38:02.034995 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944a219-80d5-490c-b529-f9278c497fd6 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:38:02.038513 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27a80c-4afa-4b62-91b6-6c1606e096f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:38:02.039766 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a80c-4afa-4b62-91b6-6c1606e096f0 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:38:02.040038 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a80c-4afa-4b62-91b6-6c1606e096f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:38:02.040303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a80c-4afa-4b62-91b6-6c1606e096f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:38:02.049256 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27a80c-4afa-4b62-91b6-6c1606e096f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:38:02.050681 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27a80c-4afa-4b62-91b6-6c1606e096f0 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:38:02.060262 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 441/893] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:38:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:38:11.661372 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=33 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:38:12.055919 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=33 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:39:24.625472 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e2bd6-7fa0-4880-9b7a-3b86bd39afb3 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:24.627102 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e2bd6-7fa0-4880-9b7a-3b86bd39afb3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:24.627455 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e2bd6-7fa0-4880-9b7a-3b86bd39afb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:24.646945 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-512e2bd6-7fa0-4880-9b7a-3b86bd39afb3 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:39:24.648680 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-512e2bd6-7fa0-4880-9b7a-3b86bd39afb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:39:24.656320 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 453/894] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:39:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:39:24.665047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440431-eef6-46a2-a28d-1d1e4f07d4d6 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:24.665554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440431-eef6-46a2-a28d-1d1e4f07d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:24.665554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440431-eef6-46a2-a28d-1d1e4f07d4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:24.684860 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-da440431-eef6-46a2-a28d-1d1e4f07d4d6 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:39:24.686034 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-da440431-eef6-46a2-a28d-1d1e4f07d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:39:24.693900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 442/895] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:39:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:39:24.698933 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e2bd6-7fa0-4880-9b7a-3b86bd39afb3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:39:24.708446 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e2bd6-7fa0-4880-9b7a-3b86bd39afb3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:39:24.713551 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63591c30-fbca-4078-b0ae-524bf7c4293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:39:24.714142 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63591c30-fbca-4078-b0ae-524bf7c4293e admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:24.714421 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63591c30-fbca-4078-b0ae-524bf7c4293e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:24.714693 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63591c30-fbca-4078-b0ae-524bf7c4293e admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:24.715358 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63591c30-fbca-4078-b0ae-524bf7c4293e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:39:24.715660 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63591c30-fbca-4078-b0ae-524bf7c4293e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:39:24.716664 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: WARNING py.warnings [None req-63591c30-fbca-4078-b0ae-524bf7c4293e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:39:24.716664 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: warnings.warn(msg) Oct 29 20:39:24.716664 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: Oct 29 20:39:24.717546 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63591c30-fbca-4078-b0ae-524bf7c4293e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:39:24.729191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 454/896] 10.222.0.40 () {58 vars in 1153 bytes} [Sat Oct 29 20:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:39:24.738507 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da440431-eef6-46a2-a28d-1d1e4f07d4d6 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:39:24.748264 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da440431-eef6-46a2-a28d-1d1e4f07d4d6 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:39:24.752739 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2581803-9627-41c6-a4a8-05cbfe90b603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:39:24.753319 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2581803-9627-41c6-a4a8-05cbfe90b603 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:24.753592 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2581803-9627-41c6-a4a8-05cbfe90b603 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:24.753859 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2581803-9627-41c6-a4a8-05cbfe90b603 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:24.754482 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2581803-9627-41c6-a4a8-05cbfe90b603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:39:24.755502 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: WARNING py.warnings [None req-c2581803-9627-41c6-a4a8-05cbfe90b603 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:39:24.755502 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: warnings.warn(msg) Oct 29 20:39:24.755502 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: Oct 29 20:39:24.756672 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2581803-9627-41c6-a4a8-05cbfe90b603 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:39:24.785130 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 443/897] 10.222.0.40 () {60 vars in 1153 bytes} [Sat Oct 29 20:39:24 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:39:24.789815 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63591c30-fbca-4078-b0ae-524bf7c4293e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:39:24.800027 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63591c30-fbca-4078-b0ae-524bf7c4293e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:39:24.857879 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2d8b5-f3f7-4be1-9c22-a32686aeb2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:39:24.858475 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2d8b5-f3f7-4be1-9c22-a32686aeb2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:24.858751 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2d8b5-f3f7-4be1-9c22-a32686aeb2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:24.859020 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2d8b5-f3f7-4be1-9c22-a32686aeb2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:24.859688 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2d8b5-f3f7-4be1-9c22-a32686aeb2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:39:24.860700 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: WARNING py.warnings [None req-a6f2d8b5-f3f7-4be1-9c22-a32686aeb2e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:39:24.860700 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: warnings.warn(msg) Oct 29 20:39:24.860700 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: Oct 29 20:39:24.861927 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2d8b5-f3f7-4be1-9c22-a32686aeb2e4 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:39:24.882444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 455/898] 10.222.0.40 () {60 vars in 1144 bytes} [Sat Oct 29 20:39:24 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:39:24.886568 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2581803-9627-41c6-a4a8-05cbfe90b603 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:39:24.896649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2581803-9627-41c6-a4a8-05cbfe90b603 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:39:24.901196 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84fa09-5d1c-492c-8c73-d5288b9e4039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:39:24.901786 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84fa09-5d1c-492c-8c73-d5288b9e4039 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:24.902064 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84fa09-5d1c-492c-8c73-d5288b9e4039 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:24.902335 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84fa09-5d1c-492c-8c73-d5288b9e4039 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:24.903019 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84fa09-5d1c-492c-8c73-d5288b9e4039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:39:24.904734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84fa09-5d1c-492c-8c73-d5288b9e4039 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:39:24.918112 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 444/899] 10.222.0.40 () {58 vars in 1122 bytes} [Sat Oct 29 20:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 20:39:24.922044 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2d8b5-f3f7-4be1-9c22-a32686aeb2e4 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:39:24.932712 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2d8b5-f3f7-4be1-9c22-a32686aeb2e4 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:39:24.937184 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6e245-7297-4e8e-a2b5-d0bac570f4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:39:24.937772 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6e245-7297-4e8e-a2b5-d0bac570f4cb admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:24.938044 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6e245-7297-4e8e-a2b5-d0bac570f4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:24.938308 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6e245-7297-4e8e-a2b5-d0bac570f4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:24.938930 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6e245-7297-4e8e-a2b5-d0bac570f4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:39:24.940540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6e245-7297-4e8e-a2b5-d0bac570f4cb admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:39:24.953404 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 456/900] 10.222.0.40 () {58 vars in 1122 bytes} [Sat Oct 29 20:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 20:39:24.957279 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84fa09-5d1c-492c-8c73-d5288b9e4039 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:39:24.967252 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84fa09-5d1c-492c-8c73-d5288b9e4039 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:39:24.971840 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69587add-6a2f-49e6-9bab-71909659addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:39:24.972475 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69587add-6a2f-49e6-9bab-71909659addb admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:24.972754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69587add-6a2f-49e6-9bab-71909659addb admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:24.973027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69587add-6a2f-49e6-9bab-71909659addb admin admin] PATH_INFO: `/v3/projects/3e524c97feb645968ba303da13815758/users/4714cc2ed8a64f0f9f88c2a50fa35d11/roles/b2dae64b76124d298b982ee42347b223` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:24.987978 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69587add-6a2f-49e6-9bab-71909659addb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e524c97feb645968ba303da13815758, user_id=4714cc2ed8a64f0f9f88c2a50fa35d11, role_id=b2dae64b76124d298b982ee42347b223)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:39:24.990643 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69587add-6a2f-49e6-9bab-71909659addb admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:39:25.004431 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 445/901] 10.222.0.40 () {60 vars in 1483 bytes} [Sat Oct 29 20:39:24 2022] PUT /identity/v3/projects/3e524c97feb645968ba303da13815758/users/4714cc2ed8a64f0f9f88c2a50fa35d11/roles/b2dae64b76124d298b982ee42347b223 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:39:25.015352 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2b22b-ea14-4a87-92b4-02353cef2ac0 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:25.015640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2b22b-ea14-4a87-92b4-02353cef2ac0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:25.015907 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2b22b-ea14-4a87-92b4-02353cef2ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:25.043408 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b9a2b22b-ea14-4a87-92b4-02353cef2ac0 None None] MFA Rules not processed for user `4714cc2ed8a64f0f9f88c2a50fa35d11`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:39:25.044579 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b9a2b22b-ea14-4a87-92b4-02353cef2ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:39:25.107280 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 457/902] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:39:25 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:39:25.120731 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e6560-e1f0-42b1-88d3-587d1092ecf7 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:25.121002 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e6560-e1f0-42b1-88d3-587d1092ecf7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:25.121277 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e6560-e1f0-42b1-88d3-587d1092ecf7 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:25.122588 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 446/903] 10.222.0.40 () {54 vars in 963 bytes} [Sat Oct 29 20:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:39:25.127170 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacf670-d550-4568-818f-e5dbca019e9f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:25.127480 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacf670-d550-4568-818f-e5dbca019e9f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:25.127754 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacf670-d550-4568-818f-e5dbca019e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:25.147405 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0dacf670-d550-4568-818f-e5dbca019e9f None None] MFA Rules not processed for user `2a21be7abe924b459ffe156f914e6ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:39:25.148581 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0dacf670-d550-4568-818f-e5dbca019e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:39:25.192358 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:39:25.201489 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 458/904] 10.222.0.40 () {58 vars in 1060 bytes} [Sat Oct 29 20:39:25 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:39:25.209038 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e6560-e1f0-42b1-88d3-587d1092ecf7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:39:25.219604 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e6560-e1f0-42b1-88d3-587d1092ecf7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:39:25.223041 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927a866-7f25-4434-9219-651a77aa4e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a21be7abe924b459ffe156f914e6ff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:39:25.223673 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927a866-7f25-4434-9219-651a77aa4e7d service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:25.223952 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927a866-7f25-4434-9219-651a77aa4e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:25.224226 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927a866-7f25-4434-9219-651a77aa4e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:25.232345 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927a866-7f25-4434-9219-651a77aa4e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:39:25.233772 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927a866-7f25-4434-9219-651a77aa4e7d service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:39:25.243653 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 447/905] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:39:25 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 20:39:25.281270 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a42451-eaf3-4283-aec7-1267836d5213 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:25.281550 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a42451-eaf3-4283-aec7-1267836d5213 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:25.281819 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a42451-eaf3-4283-aec7-1267836d5213 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:25.283074 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 459/906] 10.222.0.40 () {52 vars in 830 bytes} [Sat Oct 29 20:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:39:25.286583 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927a866-7f25-4434-9219-651a77aa4e7d service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:39:25.350924 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927a866-7f25-4434-9219-651a77aa4e7d service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:39:25.355622 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:39:25.356245 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:25.356520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:25.356789 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] PATH_INFO: `/v3/users/4714cc2ed8a64f0f9f88c2a50fa35d11` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:25.357922 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4714cc2ed8a64f0f9f88c2a50fa35d11)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:39:25.358958 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: WARNING py.warnings [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:39:25.358958 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: warnings.warn(msg) Oct 29 20:39:25.358958 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: Oct 29 20:39:25.360196 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:39:25.427190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4714cc2ed8a64f0f9f88c2a50fa35d11'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:39:25.450152 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4714cc2ed8a64f0f9f88c2a50fa35d11'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:39:25.464326 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4714cc2ed8a64f0f9f88c2a50fa35d11'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:39:25.465009 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4714cc2ed8a64f0f9f88c2a50fa35d11'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:39:25.474359 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4714cc2ed8a64f0f9f88c2a50fa35d11'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:39:25.480507 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 448/907] 10.222.0.40 () {58 vars in 1224 bytes} [Sat Oct 29 20:39:25 2022] DELETE /identity/v3/users/4714cc2ed8a64f0f9f88c2a50fa35d11 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:39:25.484895 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9cbc3-4e27-4d49-af13-66d417a84579 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:25.485173 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9cbc3-4e27-4d49-af13-66d417a84579 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:25.485442 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9cbc3-4e27-4d49-af13-66d417a84579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:25.627104 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6ef9cbc3-4e27-4d49-af13-66d417a84579 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:39:25.628356 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6ef9cbc3-4e27-4d49-af13-66d417a84579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:39:25.686936 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 460/908] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:39:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:39:25.697384 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:39:25.698775 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:39:25.704076 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:39:25.755635 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8e728-74cf-4859-9425-bf8895158431 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:39:25.760253 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c01209-9f4b-4e04-bae1-a91ef2b72333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:39:25.760850 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c01209-9f4b-4e04-bae1-a91ef2b72333 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:25.761122 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c01209-9f4b-4e04-bae1-a91ef2b72333 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:25.761390 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c01209-9f4b-4e04-bae1-a91ef2b72333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:25.770005 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c01209-9f4b-4e04-bae1-a91ef2b72333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:39:25.771459 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c01209-9f4b-4e04-bae1-a91ef2b72333 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:39:25.781070 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 449/909] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:39:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:39:26.138788 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9cbc3-4e27-4d49-af13-66d417a84579 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:39:26.140293 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6ef9cbc3-4e27-4d49-af13-66d417a84579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:39:26.153163 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9cbc3-4e27-4d49-af13-66d417a84579 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:39:26.158023 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc82cf3-9efa-47b4-9051-510bab8a1f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:39:26.159553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc82cf3-9efa-47b4-9051-510bab8a1f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:39:26.159894 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc82cf3-9efa-47b4-9051-510bab8a1f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:39:26.160223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc82cf3-9efa-47b4-9051-510bab8a1f79 admin admin] PATH_INFO: `/v3/projects/3e524c97feb645968ba303da13815758` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:39:26.161545 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc82cf3-9efa-47b4-9051-510bab8a1f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e524c97feb645968ba303da13815758)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:39:26.162613 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: WARNING py.warnings [None req-dcc82cf3-9efa-47b4-9051-510bab8a1f79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:39:26.162613 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: warnings.warn(msg) Oct 29 20:39:26.162613 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: Oct 29 20:39:26.165808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc82cf3-9efa-47b4-9051-510bab8a1f79 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:39:26.227665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dcc82cf3-9efa-47b4-9051-510bab8a1f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e524c97feb645968ba303da13815758', 'request_id': 'req-dcc82cf3-9efa-47b4-9051-510bab8a1f79'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:39:26.240612 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dcc82cf3-9efa-47b4-9051-510bab8a1f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e524c97feb645968ba303da13815758', 'request_id': 'req-dcc82cf3-9efa-47b4-9051-510bab8a1f79'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:39:26.250958 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dcc82cf3-9efa-47b4-9051-510bab8a1f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e524c97feb645968ba303da13815758', 'request_id': 'req-dcc82cf3-9efa-47b4-9051-510bab8a1f79'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:39:26.265892 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dcc82cf3-9efa-47b4-9051-510bab8a1f79 admin admin] The token cache is being invalidate because project 3e524c97feb645968ba303da13815758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 20:39:26.266183 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dcc82cf3-9efa-47b4-9051-510bab8a1f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:39:26.266862 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dcc82cf3-9efa-47b4-9051-510bab8a1f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:39:26.268452 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 461/910] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Oct 29 20:39:26 2022] DELETE /identity/v3/projects/3e524c97feb645968ba303da13815758 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:39:35.777122 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=25 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:39:36.262427 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:40:47.642180 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dcede-466b-4e75-89c3-307e30fdf2c8 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:40:47.642768 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dcede-466b-4e75-89c3-307e30fdf2c8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:40:47.642768 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dcede-466b-4e75-89c3-307e30fdf2c8 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:40:47.644093 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 450/911] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 20:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:40:47.649204 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f54ef-0d9a-4795-88b4-e85853781c4f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:40:47.649637 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f54ef-0d9a-4795-88b4-e85853781c4f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:40:47.649786 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f54ef-0d9a-4795-88b4-e85853781c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:40:47.718510 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ba5f54ef-0d9a-4795-88b4-e85853781c4f None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:40:47.719742 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ba5f54ef-0d9a-4795-88b4-e85853781c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:40:47.812698 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 462/912] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 20:40:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:40:47.975853 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dcede-466b-4e75-89c3-307e30fdf2c8 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:40:47.977539 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-692dcede-466b-4e75-89c3-307e30fdf2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:40:48.068068 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dcede-466b-4e75-89c3-307e30fdf2c8 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:40:48.073021 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d5788-c660-4302-98e2-0bd51644c1f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:40:48.073619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d5788-c660-4302-98e2-0bd51644c1f5 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:40:48.073900 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d5788-c660-4302-98e2-0bd51644c1f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:40:48.074175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d5788-c660-4302-98e2-0bd51644c1f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:40:48.082262 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d5788-c660-4302-98e2-0bd51644c1f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:40:48.084005 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d5788-c660-4302-98e2-0bd51644c1f5 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:40:48.093284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 451/913] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:40:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:40:49.748335 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b900492-fa6f-469b-8c6e-29fbea7a4118 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:40:49.748892 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b900492-fa6f-469b-8c6e-29fbea7a4118 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:40:49.748892 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b900492-fa6f-469b-8c6e-29fbea7a4118 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:40:49.750256 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 463/914] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 20:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:40:49.755117 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db919a5a-a75e-481a-98ec-ecff6c15be61 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:40:49.755760 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db919a5a-a75e-481a-98ec-ecff6c15be61 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:40:49.755760 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db919a5a-a75e-481a-98ec-ecff6c15be61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:40:49.775285 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-db919a5a-a75e-481a-98ec-ecff6c15be61 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:40:49.776519 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-db919a5a-a75e-481a-98ec-ecff6c15be61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:40:49.784520 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 452/915] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 20:40:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:40:49.945429 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b900492-fa6f-469b-8c6e-29fbea7a4118 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:40:49.959265 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b900492-fa6f-469b-8c6e-29fbea7a4118 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:40:49.964182 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cac941-2c58-4caa-b410-d9ba9fba7af2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:40:49.964827 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cac941-2c58-4caa-b410-d9ba9fba7af2 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:40:49.965104 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cac941-2c58-4caa-b410-d9ba9fba7af2 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:40:49.965989 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cac941-2c58-4caa-b410-d9ba9fba7af2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:40:49.974563 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cac941-2c58-4caa-b410-d9ba9fba7af2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:40:49.976182 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cac941-2c58-4caa-b410-d9ba9fba7af2 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:40:49.985356 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 464/916] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:40:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:40:52.996168 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcceedd-b9df-4a42-86c7-4e5e99a80725 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:40:52.996734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcceedd-b9df-4a42-86c7-4e5e99a80725 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:40:52.996841 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcceedd-b9df-4a42-86c7-4e5e99a80725 None None] PATH_INFO: `/v3` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:40:52.998065 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 453/917] 10.222.0.25 () {54 vars in 925 bytes} [Sat Oct 29 20:40:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:40:53.028161 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d3c96-658f-4111-a65a-237c779ba03f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:40:53.028592 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d3c96-658f-4111-a65a-237c779ba03f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:40:53.028701 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d3c96-658f-4111-a65a-237c779ba03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:40:53.059521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-799d3c96-658f-4111-a65a-237c779ba03f None None] MFA Rules not processed for user `d70c0c1dd66244b68052c278d9b39dce`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:40:53.060732 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-799d3c96-658f-4111-a65a-237c779ba03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:40:53.113954 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:40:53.123452 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 465/918] 10.222.0.25 () {58 vars in 1015 bytes} [Sat Oct 29 20:40:53 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:40:57.039712 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6db697-56b5-44fe-a843-489107bac87f None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:40:57.040144 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6db697-56b5-44fe-a843-489107bac87f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:40:57.040257 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6db697-56b5-44fe-a843-489107bac87f None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:40:57.041554 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 454/919] 10.222.0.40 () {54 vars in 961 bytes} [Sat Oct 29 20:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:40:57.046452 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2c8ca-e7f6-4082-a27f-364140b5a26c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:40:57.046839 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2c8ca-e7f6-4082-a27f-364140b5a26c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:40:57.047008 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2c8ca-e7f6-4082-a27f-364140b5a26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:40:57.068190 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c5a2c8ca-e7f6-4082-a27f-364140b5a26c None None] MFA Rules not processed for user `d70c0c1dd66244b68052c278d9b39dce`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:40:57.069394 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c5a2c8ca-e7f6-4082-a27f-364140b5a26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:40:57.077978 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 466/920] 10.222.0.40 () {58 vars in 1058 bytes} [Sat Oct 29 20:40:57 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:40:57.085636 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6db697-56b5-44fe-a843-489107bac87f None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:40:57.100116 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6db697-56b5-44fe-a843-489107bac87f None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:40:57.105092 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68738788-e398-4387-91c5-18ceadf7d2a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd70c0c1dd66244b68052c278d9b39dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:40:57.105671 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68738788-e398-4387-91c5-18ceadf7d2a1 service placement] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:40:57.105943 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68738788-e398-4387-91c5-18ceadf7d2a1 service placement] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:40:57.106208 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68738788-e398-4387-91c5-18ceadf7d2a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:40:57.115330 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68738788-e398-4387-91c5-18ceadf7d2a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:40:57.116902 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68738788-e398-4387-91c5-18ceadf7d2a1 service placement] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:40:57.126182 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 455/921] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:40:57 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:41:02.010633 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e3aa1-f898-4ee6-9957-7bfb7158fdbc None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:02.011209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e3aa1-f898-4ee6-9957-7bfb7158fdbc None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:02.011209 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e3aa1-f898-4ee6-9957-7bfb7158fdbc None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:02.012551 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 467/922] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 20:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:41:02.017981 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e74d99-22ef-4b17-bc06-61a897a51d5c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:02.018415 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e74d99-22ef-4b17-bc06-61a897a51d5c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:02.018517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e74d99-22ef-4b17-bc06-61a897a51d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:02.039065 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f0e74d99-22ef-4b17-bc06-61a897a51d5c None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:41:02.040303 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f0e74d99-22ef-4b17-bc06-61a897a51d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:41:02.048015 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 456/923] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 20:41:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:41:02.211517 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e3aa1-f898-4ee6-9957-7bfb7158fdbc None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:41:02.224797 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e3aa1-f898-4ee6-9957-7bfb7158fdbc None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:41:02.229547 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39310210-edd9-4802-a673-03e981fb78ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:41:02.230132 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39310210-edd9-4802-a673-03e981fb78ad service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:02.230406 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39310210-edd9-4802-a673-03e981fb78ad service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:02.230673 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39310210-edd9-4802-a673-03e981fb78ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:02.238464 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39310210-edd9-4802-a673-03e981fb78ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:41:02.240235 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39310210-edd9-4802-a673-03e981fb78ad service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:41:02.249569 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 468/924] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:41:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:41:03.881231 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edcc52-54b9-4302-8955-e0274193892c None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:03.881776 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edcc52-54b9-4302-8955-e0274193892c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:03.881776 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edcc52-54b9-4302-8955-e0274193892c None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:03.883112 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 457/925] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 20:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:41:03.887932 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d7dbf-83b1-4867-ba8c-e849f7b9aa04 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:03.888388 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d7dbf-83b1-4867-ba8c-e849f7b9aa04 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:03.888602 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d7dbf-83b1-4867-ba8c-e849f7b9aa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:03.907904 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ea9d7dbf-83b1-4867-ba8c-e849f7b9aa04 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:41:03.909086 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ea9d7dbf-83b1-4867-ba8c-e849f7b9aa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:41:03.917279 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 469/926] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 20:41:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:41:04.077670 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edcc52-54b9-4302-8955-e0274193892c None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:41:04.091794 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edcc52-54b9-4302-8955-e0274193892c None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:41:04.096716 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0ae61-9e70-46f4-a45b-becbe6219914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:41:04.097309 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0ae61-9e70-46f4-a45b-becbe6219914 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:04.097585 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0ae61-9e70-46f4-a45b-becbe6219914 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:04.097857 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0ae61-9e70-46f4-a45b-becbe6219914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:04.107047 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0ae61-9e70-46f4-a45b-becbe6219914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:41:04.108695 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0ae61-9e70-46f4-a45b-becbe6219914 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:41:04.118580 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 458/927] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:41:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:41:08.411699 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed878fa-6745-432f-b1e1-dca0a6a5bb8e None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:08.412301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed878fa-6745-432f-b1e1-dca0a6a5bb8e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:08.412301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed878fa-6745-432f-b1e1-dca0a6a5bb8e None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:08.413572 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 470/928] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:41:08.418927 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e024cd9-e843-433f-a93c-2f785d53cad6 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:08.419343 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e024cd9-e843-433f-a93c-2f785d53cad6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:08.419523 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e024cd9-e843-433f-a93c-2f785d53cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:08.442870 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9e024cd9-e843-433f-a93c-2f785d53cad6 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:41:08.444077 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9e024cd9-e843-433f-a93c-2f785d53cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:41:08.451717 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 459/929] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:41:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:41:08.791567 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed878fa-6745-432f-b1e1-dca0a6a5bb8e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:41:08.793345 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-aed878fa-6745-432f-b1e1-dca0a6a5bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:41:08.850692 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed878fa-6745-432f-b1e1-dca0a6a5bb8e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:41:08.854189 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a769d76-85ad-4bb7-96f9-43429ff3eeec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:41:08.854786 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a769d76-85ad-4bb7-96f9-43429ff3eeec service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:08.855064 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a769d76-85ad-4bb7-96f9-43429ff3eeec service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:08.855358 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a769d76-85ad-4bb7-96f9-43429ff3eeec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:08.864170 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a769d76-85ad-4bb7-96f9-43429ff3eeec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:41:08.865790 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a769d76-85ad-4bb7-96f9-43429ff3eeec service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:41:08.874955 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 471/930] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:41:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:41:11.279794 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387dfac-ba42-4589-b2d1-69ada653b0a4 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:11.280281 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387dfac-ba42-4589-b2d1-69ada653b0a4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:11.280392 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387dfac-ba42-4589-b2d1-69ada653b0a4 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:11.281669 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 460/931] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:41:11.287039 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a6cca-8e22-4dab-a3a1-c974d63aa418 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:11.287484 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a6cca-8e22-4dab-a3a1-c974d63aa418 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:11.287638 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a6cca-8e22-4dab-a3a1-c974d63aa418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:11.307358 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-3a6a6cca-8e22-4dab-a3a1-c974d63aa418 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:41:11.308542 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3a6a6cca-8e22-4dab-a3a1-c974d63aa418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:41:11.316227 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 472/932] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:41:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:41:11.657765 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387dfac-ba42-4589-b2d1-69ada653b0a4 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:41:11.659470 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7387dfac-ba42-4589-b2d1-69ada653b0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:41:11.672416 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387dfac-ba42-4589-b2d1-69ada653b0a4 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:41:11.676709 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261c46f-85a5-407c-886f-46760b619f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:41:11.677288 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261c46f-85a5-407c-886f-46760b619f27 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:11.677558 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261c46f-85a5-407c-886f-46760b619f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:11.677822 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261c46f-85a5-407c-886f-46760b619f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:11.686690 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261c46f-85a5-407c-886f-46760b619f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:41:11.688135 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261c46f-85a5-407c-886f-46760b619f27 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:41:11.698891 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 461/933] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:41:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 20:41:15.599558 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6235cef-bcbe-4a68-9825-a6a0b1ee4aa1 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:15.600158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6235cef-bcbe-4a68-9825-a6a0b1ee4aa1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:15.600158 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6235cef-bcbe-4a68-9825-a6a0b1ee4aa1 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:15.601476 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 473/934] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:41:15.606807 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b4a14-551e-4641-9977-fc2f82c1ee9e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:15.607238 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b4a14-551e-4641-9977-fc2f82c1ee9e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:15.607372 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b4a14-551e-4641-9977-fc2f82c1ee9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:15.626843 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-176b4a14-551e-4641-9977-fc2f82c1ee9e None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:41:15.628139 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-176b4a14-551e-4641-9977-fc2f82c1ee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:41:15.636363 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 462/935] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:41:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:41:15.990814 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6235cef-bcbe-4a68-9825-a6a0b1ee4aa1 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:41:15.992516 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c6235cef-bcbe-4a68-9825-a6a0b1ee4aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:41:16.049457 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6235cef-bcbe-4a68-9825-a6a0b1ee4aa1 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:41:16.053257 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846fd10-3331-43d1-b808-26bffb4e8de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a21be7abe924b459ffe156f914e6ff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:41:16.053853 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846fd10-3331-43d1-b808-26bffb4e8de2 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:16.054129 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846fd10-3331-43d1-b808-26bffb4e8de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:16.054398 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846fd10-3331-43d1-b808-26bffb4e8de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:16.063200 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846fd10-3331-43d1-b808-26bffb4e8de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:41:16.064655 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846fd10-3331-43d1-b808-26bffb4e8de2 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:41:16.073998 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 474/936] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:41:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:41:18.473619 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aad84-36c4-40c2-ab14-f1ba4d78eed8 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:18.474743 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aad84-36c4-40c2-ab14-f1ba4d78eed8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:18.474743 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aad84-36c4-40c2-ab14-f1ba4d78eed8 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:18.476128 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 463/937] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 20:41:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:41:18.481371 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180bc3a-d756-4a77-b36c-43cfd455967c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:18.481792 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180bc3a-d756-4a77-b36c-43cfd455967c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:18.481918 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180bc3a-d756-4a77-b36c-43cfd455967c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:18.501321 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a180bc3a-d756-4a77-b36c-43cfd455967c None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:41:18.502445 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a180bc3a-d756-4a77-b36c-43cfd455967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:41:18.510219 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 475/938] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 20:41:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:41:18.872187 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0aad84-36c4-40c2-ab14-f1ba4d78eed8 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:41:18.873846 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ee0aad84-36c4-40c2-ab14-f1ba4d78eed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:41:18.882061 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=70 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:41:18.888507 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0aad84-36c4-40c2-ab14-f1ba4d78eed8 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:41:18.892425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902eb42-91d8-4c85-a20a-25220c97d17f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a21be7abe924b459ffe156f914e6ff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:41:18.893016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902eb42-91d8-4c85-a20a-25220c97d17f service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:41:18.893290 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902eb42-91d8-4c85-a20a-25220c97d17f service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:41:18.893555 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902eb42-91d8-4c85-a20a-25220c97d17f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:41:18.903420 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902eb42-91d8-4c85-a20a-25220c97d17f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:41:18.904825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902eb42-91d8-4c85-a20a-25220c97d17f service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:41:18.914101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 464/939] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:41:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:41:28.496423 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=70 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:41:28.909922 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:42:34.822112 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee8de-5e7e-4e4a-9ca8-2d6168beda4a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:34.822746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee8de-5e7e-4e4a-9ca8-2d6168beda4a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:34.822746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee8de-5e7e-4e4a-9ca8-2d6168beda4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:34.842915 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-756ee8de-5e7e-4e4a-9ca8-2d6168beda4a None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:34.844163 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-756ee8de-5e7e-4e4a-9ca8-2d6168beda4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:34.853458 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 476/940] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:42:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:42:34.862427 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4c5d2-659a-466d-8937-56bdebb60389 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:34.862979 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e150e31-88a4-4229-98ba-195a473be1b9 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:34.863097 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4c5d2-659a-466d-8937-56bdebb60389 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:34.863195 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e150e31-88a4-4229-98ba-195a473be1b9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:34.863283 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4c5d2-659a-466d-8937-56bdebb60389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:34.863412 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e150e31-88a4-4229-98ba-195a473be1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:34.882470 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8e150e31-88a4-4229-98ba-195a473be1b9 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:34.882663 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-6bf4c5d2-659a-466d-8937-56bdebb60389 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:34.883702 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6bf4c5d2-659a-466d-8937-56bdebb60389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:34.883808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8e150e31-88a4-4229-98ba-195a473be1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:34.891701 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 465/941] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:42:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:42:34.891834 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 477/942] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:42:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:42:34.896606 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4c5d2-659a-466d-8937-56bdebb60389 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:34.900710 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd5b42-88ac-46ad-8e36-39c78821840e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:34.900999 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd5b42-88ac-46ad-8e36-39c78821840e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:34.901275 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd5b42-88ac-46ad-8e36-39c78821840e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:34.906718 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4c5d2-659a-466d-8937-56bdebb60389 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:34.912955 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf336d-80f2-4951-8349-16814e9d8fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:34.913570 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf336d-80f2-4951-8349-16814e9d8fbc admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:34.913860 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf336d-80f2-4951-8349-16814e9d8fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:34.914106 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf336d-80f2-4951-8349-16814e9d8fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:34.914736 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf336d-80f2-4951-8349-16814e9d8fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:42:34.915029 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf336d-80f2-4951-8349-16814e9d8fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:34.916146 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: WARNING py.warnings [None req-42bf336d-80f2-4951-8349-16814e9d8fbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:42:34.916146 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: warnings.warn(msg) Oct 29 20:42:34.916146 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: Oct 29 20:42:34.917038 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf336d-80f2-4951-8349-16814e9d8fbc admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:34.922510 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-53fd5b42-88ac-46ad-8e36-39c78821840e None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:34.923756 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-53fd5b42-88ac-46ad-8e36-39c78821840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:34.929356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 466/943] 10.222.0.40 () {58 vars in 1153 bytes} [Sat Oct 29 20:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:42:34.932232 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 478/944] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:42:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:42:34.936817 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf336d-80f2-4951-8349-16814e9d8fbc admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:34.937368 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd5b42-88ac-46ad-8e36-39c78821840e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:34.946846 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf336d-80f2-4951-8349-16814e9d8fbc admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:34.947425 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd5b42-88ac-46ad-8e36-39c78821840e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:34.951595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e0e0c-aaaf-4f07-9203-535f0231a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:34.951955 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d411-aad4-4493-86fe-96787f637de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:34.952178 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0e0c-aaaf-4f07-9203-535f0231a9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:34.952455 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0e0c-aaaf-4f07-9203-535f0231a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:34.952549 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d411-aad4-4493-86fe-96787f637de5 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:34.952725 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0e0c-aaaf-4f07-9203-535f0231a9c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:34.952817 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d411-aad4-4493-86fe-96787f637de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:34.953059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d411-aad4-4493-86fe-96787f637de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:34.953359 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e0e0c-aaaf-4f07-9203-535f0231a9c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 20:42:34.953660 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e0e0c-aaaf-4f07-9203-535f0231a9c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:34.953758 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36d411-aad4-4493-86fe-96787f637de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:34.954702 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: WARNING py.warnings [None req-cf36d411-aad4-4493-86fe-96787f637de5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:42:34.954702 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: warnings.warn(msg) Oct 29 20:42:34.954702 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: Oct 29 20:42:34.955242 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e0e0c-aaaf-4f07-9203-535f0231a9c6 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:34.955925 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36d411-aad4-4493-86fe-96787f637de5 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:34.968046 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 467/945] 10.222.0.40 () {58 vars in 1153 bytes} [Sat Oct 29 20:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 20:42:34.976680 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e0e0c-aaaf-4f07-9203-535f0231a9c6 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:34.986748 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e0e0c-aaaf-4f07-9203-535f0231a9c6 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:34.991838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e22e9a-98fc-4ed6-b0b5-2677b34beb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:34.992443 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e22e9a-98fc-4ed6-b0b5-2677b34beb72 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:34.992720 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e22e9a-98fc-4ed6-b0b5-2677b34beb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:34.992988 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e22e9a-98fc-4ed6-b0b5-2677b34beb72 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:34.993617 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e22e9a-98fc-4ed6-b0b5-2677b34beb72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:34.995536 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e22e9a-98fc-4ed6-b0b5-2677b34beb72 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:34.995679 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 479/946] 10.222.0.40 () {60 vars in 1153 bytes} [Sat Oct 29 20:42:34 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 20:42:34.999668 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d411-aad4-4493-86fe-96787f637de5 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:35.023628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 468/947] 10.222.0.40 () {60 vars in 1153 bytes} [Sat Oct 29 20:42:34 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 20:42:35.027771 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e22e9a-98fc-4ed6-b0b5-2677b34beb72 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:35.063549 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d411-aad4-4493-86fe-96787f637de5 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:35.089990 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e22e9a-98fc-4ed6-b0b5-2677b34beb72 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:35.094517 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0f168-833c-4628-9594-9f52ab0d3d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:35.095117 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0f168-833c-4628-9594-9f52ab0d3d4c admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:35.095454 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0f168-833c-4628-9594-9f52ab0d3d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:35.095724 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0f168-833c-4628-9594-9f52ab0d3d4c admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:35.096346 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0f168-833c-4628-9594-9f52ab0d3d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:35.097356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: WARNING py.warnings [None req-55c0f168-833c-4628-9594-9f52ab0d3d4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 20:42:35.097356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: warnings.warn(msg) Oct 29 20:42:35.097356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: Oct 29 20:42:35.098570 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0f168-833c-4628-9594-9f52ab0d3d4c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:35.123586 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 469/948] 10.222.0.40 () {60 vars in 1144 bytes} [Sat Oct 29 20:42:35 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 20:42:35.123796 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e756384-2545-4e36-83b9-17cd93b2b135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:35.123921 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e756384-2545-4e36-83b9-17cd93b2b135 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:35.124186 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e756384-2545-4e36-83b9-17cd93b2b135 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:35.124457 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e756384-2545-4e36-83b9-17cd93b2b135 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:35.124601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0f168-833c-4628-9594-9f52ab0d3d4c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:35.125085 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e756384-2545-4e36-83b9-17cd93b2b135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:35.127016 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e756384-2545-4e36-83b9-17cd93b2b135 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:35.134534 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0f168-833c-4628-9594-9f52ab0d3d4c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:35.139558 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faabfc8-25ea-4ed5-b7d3-325afde49029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:35.140191 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faabfc8-25ea-4ed5-b7d3-325afde49029 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:35.140492 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faabfc8-25ea-4ed5-b7d3-325afde49029 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:35.140782 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faabfc8-25ea-4ed5-b7d3-325afde49029 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:35.141583 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faabfc8-25ea-4ed5-b7d3-325afde49029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:35.143375 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faabfc8-25ea-4ed5-b7d3-325afde49029 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:35.150736 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 480/949] 10.222.0.40 () {60 vars in 1144 bytes} [Sat Oct 29 20:42:34 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 20:42:35.154533 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e756384-2545-4e36-83b9-17cd93b2b135 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:35.157893 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 470/950] 10.222.0.40 () {58 vars in 1122 bytes} [Sat Oct 29 20:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 20:42:35.159065 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faabfc8-25ea-4ed5-b7d3-325afde49029 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:35.164842 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e756384-2545-4e36-83b9-17cd93b2b135 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:35.168755 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faabfc8-25ea-4ed5-b7d3-325afde49029 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:35.169370 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7171c-4c50-450f-aeea-4a35b66f82ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:35.169954 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7171c-4c50-450f-aeea-4a35b66f82ef admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:35.170227 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7171c-4c50-450f-aeea-4a35b66f82ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:35.170491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7171c-4c50-450f-aeea-4a35b66f82ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:35.171141 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7171c-4c50-450f-aeea-4a35b66f82ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:35.172757 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7171c-4c50-450f-aeea-4a35b66f82ef admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:35.173571 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd115fa-de8d-4356-898b-b4520ef068d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:35.174145 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd115fa-de8d-4356-898b-b4520ef068d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:35.174421 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd115fa-de8d-4356-898b-b4520ef068d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:35.174698 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd115fa-de8d-4356-898b-b4520ef068d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:35.175356 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd115fa-de8d-4356-898b-b4520ef068d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:35.177175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd115fa-de8d-4356-898b-b4520ef068d2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:35.183762 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 481/951] 10.222.0.40 () {58 vars in 1122 bytes} [Sat Oct 29 20:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 20:42:35.187597 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7171c-4c50-450f-aeea-4a35b66f82ef admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:35.188090 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 471/952] 10.222.0.40 () {58 vars in 1122 bytes} [Sat Oct 29 20:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 20:42:35.191555 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd115fa-de8d-4356-898b-b4520ef068d2 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:35.198330 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7171c-4c50-450f-aeea-4a35b66f82ef admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:35.201443 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd115fa-de8d-4356-898b-b4520ef068d2 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:35.202837 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f404c3f-87bd-4f29-b23d-07bbb9d1734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:35.203444 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f404c3f-87bd-4f29-b23d-07bbb9d1734c admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:35.203723 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f404c3f-87bd-4f29-b23d-07bbb9d1734c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:35.203992 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f404c3f-87bd-4f29-b23d-07bbb9d1734c admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:35.204613 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f404c3f-87bd-4f29-b23d-07bbb9d1734c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:35.206083 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9c58c-56bc-409f-acc8-27c3a8713c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:35.206233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f404c3f-87bd-4f29-b23d-07bbb9d1734c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:35.206709 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c58c-56bc-409f-acc8-27c3a8713c52 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:35.206989 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c58c-56bc-409f-acc8-27c3a8713c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:35.207265 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c58c-56bc-409f-acc8-27c3a8713c52 admin admin] PATH_INFO: `/v3/projects/824bd977af19499a87712ca58bef0448/users/7edf42866be642adb953dffe093f386b/roles/b2dae64b76124d298b982ee42347b223` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:35.217813 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 482/953] 10.222.0.40 () {58 vars in 1122 bytes} [Sat Oct 29 20:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 20:42:35.221741 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f404c3f-87bd-4f29-b23d-07bbb9d1734c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:35.223284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9c58c-56bc-409f-acc8-27c3a8713c52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824bd977af19499a87712ca58bef0448, user_id=7edf42866be642adb953dffe093f386b, role_id=b2dae64b76124d298b982ee42347b223)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:35.226018 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9c58c-56bc-409f-acc8-27c3a8713c52 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:35.232216 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f404c3f-87bd-4f29-b23d-07bbb9d1734c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:35.237155 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acf8e6-52bb-4861-b3b8-34bc807d9e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:35.237795 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acf8e6-52bb-4861-b3b8-34bc807d9e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:35.238073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acf8e6-52bb-4861-b3b8-34bc807d9e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:35.238344 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acf8e6-52bb-4861-b3b8-34bc807d9e81 admin admin] PATH_INFO: `/v3/projects/733f5da028894904abdd4ffb3d54e625/users/97f5d7ad683243d198dbe96a2a6222ce/roles/b2dae64b76124d298b982ee42347b223` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:35.239532 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 472/954] 10.222.0.40 () {60 vars in 1483 bytes} [Sat Oct 29 20:42:35 2022] PUT /identity/v3/projects/824bd977af19499a87712ca58bef0448/users/7edf42866be642adb953dffe093f386b/roles/b2dae64b76124d298b982ee42347b223 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 20:42:35.244835 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026efa42-c1fa-435f-b220-9addc37dcd6c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:35.245115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026efa42-c1fa-435f-b220-9addc37dcd6c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:35.245384 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026efa42-c1fa-435f-b220-9addc37dcd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:35.266330 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acf8e6-52bb-4861-b3b8-34bc807d9e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733f5da028894904abdd4ffb3d54e625, user_id=97f5d7ad683243d198dbe96a2a6222ce, role_id=b2dae64b76124d298b982ee42347b223)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:35.267795 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-026efa42-c1fa-435f-b220-9addc37dcd6c None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:35.268974 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-026efa42-c1fa-435f-b220-9addc37dcd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:35.269098 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acf8e6-52bb-4861-b3b8-34bc807d9e81 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:35.278974 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:42:35.284837 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 483/955] 10.222.0.40 () {60 vars in 1483 bytes} [Sat Oct 29 20:42:35 2022] PUT /identity/v3/projects/733f5da028894904abdd4ffb3d54e625/users/97f5d7ad683243d198dbe96a2a6222ce/roles/b2dae64b76124d298b982ee42347b223 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:42:35.291030 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4170c-a7eb-4a48-894d-49a4b92683e0 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:35.291333 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4170c-a7eb-4a48-894d-49a4b92683e0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:35.291620 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4170c-a7eb-4a48-894d-49a4b92683e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:35.312311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-55e4170c-a7eb-4a48-894d-49a4b92683e0 None None] MFA Rules not processed for user `f9beafc3b84548cf9fb3d264e0f50848`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:35.313633 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-55e4170c-a7eb-4a48-894d-49a4b92683e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:35.325425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:42:35.348158 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 473/956] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:42:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:42:35.359699 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026efa42-c1fa-435f-b220-9addc37dcd6c None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:35.375293 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 484/957] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:42:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:42:35.385070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4170c-a7eb-4a48-894d-49a4b92683e0 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:35.417581 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026efa42-c1fa-435f-b220-9addc37dcd6c None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:35.439995 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4170c-a7eb-4a48-894d-49a4b92683e0 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:35.445191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455aef0-6db7-4982-88ca-de23e2329c01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:35.445799 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455aef0-6db7-4982-88ca-de23e2329c01 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:35.446172 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455aef0-6db7-4982-88ca-de23e2329c01 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:35.446341 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455aef0-6db7-4982-88ca-de23e2329c01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:35.455764 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455aef0-6db7-4982-88ca-de23e2329c01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:35.456914 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455aef0-6db7-4982-88ca-de23e2329c01 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:35.466656 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91944516-4c8b-462a-9e9a-ba4c9be6a47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:35.467159 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 485/958] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:42:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 20:42:35.467439 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91944516-4c8b-462a-9e9a-ba4c9be6a47d service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:35.467630 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91944516-4c8b-462a-9e9a-ba4c9be6a47d service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:35.467903 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91944516-4c8b-462a-9e9a-ba4c9be6a47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:35.477537 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91944516-4c8b-462a-9e9a-ba4c9be6a47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:35.478983 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91944516-4c8b-462a-9e9a-ba4c9be6a47d service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:35.488746 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 474/959] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:42:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 20:42:40.375875 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5605c70-7e4c-4c0a-b975-0a4cf3c96e92 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:40.376388 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5605c70-7e4c-4c0a-b975-0a4cf3c96e92 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:40.376491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5605c70-7e4c-4c0a-b975-0a4cf3c96e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:40.447657 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f5605c70-7e4c-4c0a-b975-0a4cf3c96e92 None None] MFA Rules not processed for user `97f5d7ad683243d198dbe96a2a6222ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:40.449003 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f5605c70-7e4c-4c0a-b975-0a4cf3c96e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:40.624784 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 486/960] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:42:40 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:42:40.626003 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91944516-4c8b-462a-9e9a-ba4c9be6a47d service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:40.644536 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91944516-4c8b-462a-9e9a-ba4c9be6a47d service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:40.662176 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71b971-b183-44d5-b44c-315ee1daf456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:40.663560 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71b971-b183-44d5-b44c-315ee1daf456 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:40.665714 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71b971-b183-44d5-b44c-315ee1daf456 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:40.665987 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71b971-b183-44d5-b44c-315ee1daf456 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:40.666661 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71b971-b183-44d5-b44c-315ee1daf456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:40.682864 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896646b6-e6cc-4494-8746-d8361a55daa5 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:40.683558 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896646b6-e6cc-4494-8746-d8361a55daa5 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:40.683978 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896646b6-e6cc-4494-8746-d8361a55daa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:40.686383 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71b971-b183-44d5-b44c-315ee1daf456 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:40.757908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-896646b6-e6cc-4494-8746-d8361a55daa5 None None] MFA Rules not processed for user `7edf42866be642adb953dffe093f386b`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:40.759674 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-896646b6-e6cc-4494-8746-d8361a55daa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:40.768062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 475/961] 10.222.0.40 () {60 vars in 1153 bytes} [Sat Oct 29 20:42:40 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:42:40.773569 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71b971-b183-44d5-b44c-315ee1daf456 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:40.814198 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:42:40.944565 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 487/962] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:42:40 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:42:40.945578 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896646b6-e6cc-4494-8746-d8361a55daa5 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:40.959485 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71b971-b183-44d5-b44c-315ee1daf456 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:40.962089 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896646b6-e6cc-4494-8746-d8361a55daa5 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:40.966567 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391a075-e835-4ae1-bac8-8cb2021e6b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:40.967422 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a075-e835-4ae1-bac8-8cb2021e6b38 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:40.967583 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2350107-4197-4355-b336-ee62413b0621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:40.968115 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a075-e835-4ae1-bac8-8cb2021e6b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:40.968248 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2350107-4197-4355-b336-ee62413b0621 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:40.968410 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2350107-4197-4355-b336-ee62413b0621 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:40.968644 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2350107-4197-4355-b336-ee62413b0621 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:40.969166 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a075-e835-4ae1-bac8-8cb2021e6b38 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:40.969340 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2350107-4197-4355-b336-ee62413b0621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:40.971655 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2350107-4197-4355-b336-ee62413b0621 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:40.972240 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391a075-e835-4ae1-bac8-8cb2021e6b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:40.974621 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391a075-e835-4ae1-bac8-8cb2021e6b38 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:41.012146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 488/963] 10.222.0.40 () {60 vars in 1153 bytes} [Sat Oct 29 20:42:40 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 20:42:41.015967 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 476/964] 10.222.0.40 () {60 vars in 1144 bytes} [Sat Oct 29 20:42:40 2022] POST /identity/v3/users => generated 299 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 20:42:41.016210 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2350107-4197-4355-b336-ee62413b0621 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:41.030190 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391a075-e835-4ae1-bac8-8cb2021e6b38 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:41.042364 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391a075-e835-4ae1-bac8-8cb2021e6b38 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:41.062410 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:42:41.124201 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2350107-4197-4355-b336-ee62413b0621 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:41.128857 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce534c6-9b31-4bc1-b4f6-8e675391bae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:41.130196 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce534c6-9b31-4bc1-b4f6-8e675391bae1 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:41.130658 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce534c6-9b31-4bc1-b4f6-8e675391bae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:41.131095 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce534c6-9b31-4bc1-b4f6-8e675391bae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:41.131934 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce534c6-9b31-4bc1-b4f6-8e675391bae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:41.133797 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce534c6-9b31-4bc1-b4f6-8e675391bae1 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:41.137809 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce4915-8e14-4f96-a7c2-6c31304decbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:41.138430 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce4915-8e14-4f96-a7c2-6c31304decbd admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:41.138702 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce4915-8e14-4f96-a7c2-6c31304decbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:41.138966 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce4915-8e14-4f96-a7c2-6c31304decbd admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:41.139771 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce4915-8e14-4f96-a7c2-6c31304decbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:41.141849 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce4915-8e14-4f96-a7c2-6c31304decbd admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:41.147068 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 477/965] 10.222.0.40 () {58 vars in 1122 bytes} [Sat Oct 29 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 20:42:41.151453 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce534c6-9b31-4bc1-b4f6-8e675391bae1 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:41.164502 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce534c6-9b31-4bc1-b4f6-8e675391bae1 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:41.173306 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7614d-0e54-4c44-9453-79efa0f05ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:41.174275 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7614d-0e54-4c44-9453-79efa0f05ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:41.174553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7614d-0e54-4c44-9453-79efa0f05ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:41.174825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7614d-0e54-4c44-9453-79efa0f05ce5 admin admin] PATH_INFO: `/v3/projects/a5f8451986d24caa9940cb7569a91951/users/3a5f5ceacaa44495bcf520ad9c3fb006/roles/9b15e747c88749bfb25139f3bd80b395` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:41.176786 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 489/966] 10.222.0.40 () {60 vars in 1144 bytes} [Sat Oct 29 20:42:41 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 20:42:41.190271 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce4915-8e14-4f96-a7c2-6c31304decbd admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:41.208465 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7614d-0e54-4c44-9453-79efa0f05ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f8451986d24caa9940cb7569a91951, user_id=3a5f5ceacaa44495bcf520ad9c3fb006, role_id=9b15e747c88749bfb25139f3bd80b395)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:41.211692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7614d-0e54-4c44-9453-79efa0f05ce5 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:41.212368 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce4915-8e14-4f96-a7c2-6c31304decbd admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:41.218958 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab6a31-0022-4ce3-a9d8-5842981c64df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:41.219920 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6a31-0022-4ce3-a9d8-5842981c64df admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:41.220136 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6a31-0022-4ce3-a9d8-5842981c64df admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:41.223791 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6a31-0022-4ce3-a9d8-5842981c64df admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:41.225831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab6a31-0022-4ce3-a9d8-5842981c64df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:41.232675 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab6a31-0022-4ce3-a9d8-5842981c64df admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:41.233899 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 478/967] 10.222.0.40 () {60 vars in 1483 bytes} [Sat Oct 29 20:42:41 2022] PUT /identity/v3/projects/a5f8451986d24caa9940cb7569a91951/users/3a5f5ceacaa44495bcf520ad9c3fb006/roles/9b15e747c88749bfb25139f3bd80b395 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 20:42:41.238790 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7614d-0e54-4c44-9453-79efa0f05ce5 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:41.248703 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 490/968] 10.222.0.40 () {58 vars in 1122 bytes} [Sat Oct 29 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 20:42:41.249491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab6a31-0022-4ce3-a9d8-5842981c64df admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:41.267336 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab6a31-0022-4ce3-a9d8-5842981c64df admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:41.362948 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d74fd0-c64f-4962-9f8a-0dc07b430f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:41.363763 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74fd0-c64f-4962-9f8a-0dc07b430f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:41.364117 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74fd0-c64f-4962-9f8a-0dc07b430f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:41.364553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74fd0-c64f-4962-9f8a-0dc07b430f49 admin admin] PATH_INFO: `/v3/projects/ebeba3500afa4d7b8453f94ba8ccfb37/users/111a699675094bc89979195e7789b821/roles/9b15e747c88749bfb25139f3bd80b395` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:41.376498 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7614d-0e54-4c44-9453-79efa0f05ce5 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:41.382969 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d74fd0-c64f-4962-9f8a-0dc07b430f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebeba3500afa4d7b8453f94ba8ccfb37, user_id=111a699675094bc89979195e7789b821, role_id=9b15e747c88749bfb25139f3bd80b395)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:41.386190 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d74fd0-c64f-4962-9f8a-0dc07b430f49 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:41.389278 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e0788-ab9a-405c-8f7b-339e0b4a3b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:41.390467 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e0788-ab9a-405c-8f7b-339e0b4a3b32 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:41.390831 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e0788-ab9a-405c-8f7b-339e0b4a3b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:41.396949 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e0788-ab9a-405c-8f7b-339e0b4a3b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:41.398118 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e0788-ab9a-405c-8f7b-339e0b4a3b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:41.401124 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e0788-ab9a-405c-8f7b-339e0b4a3b32 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:41.406646 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 491/969] 10.222.0.40 () {60 vars in 1483 bytes} [Sat Oct 29 20:42:41 2022] PUT /identity/v3/projects/ebeba3500afa4d7b8453f94ba8ccfb37/users/111a699675094bc89979195e7789b821/roles/9b15e747c88749bfb25139f3bd80b395 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:42:41.410355 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d74fd0-c64f-4962-9f8a-0dc07b430f49 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:41.416092 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:42:41.421211 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 479/970] 10.222.0.40 () {58 vars in 1122 bytes} [Sat Oct 29 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 20:42:41.422708 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e0788-ab9a-405c-8f7b-339e0b4a3b32 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:41.441108 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e0788-ab9a-405c-8f7b-339e0b4a3b32 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:41.522294 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d74fd0-c64f-4962-9f8a-0dc07b430f49 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:41.533685 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c30ba-dc80-48df-a5c8-48a697f279a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:41.534528 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c30ba-dc80-48df-a5c8-48a697f279a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:41.534722 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c30ba-dc80-48df-a5c8-48a697f279a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:41.535001 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c30ba-dc80-48df-a5c8-48a697f279a3 admin admin] PATH_INFO: `/v3/projects/a5f8451986d24caa9940cb7569a91951/users/3a5f5ceacaa44495bcf520ad9c3fb006/roles/9b15e747c88749bfb25139f3bd80b395` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:41.539980 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c30ba-dc80-48df-a5c8-48a697f279a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f8451986d24caa9940cb7569a91951, user_id=3a5f5ceacaa44495bcf520ad9c3fb006, role_id=9b15e747c88749bfb25139f3bd80b395)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:41.540311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948868-c3b2-447e-8da9-0a885460bcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:41.541116 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948868-c3b2-447e-8da9-0a885460bcfd admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:41.541553 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948868-c3b2-447e-8da9-0a885460bcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:41.541990 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948868-c3b2-447e-8da9-0a885460bcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:41.542930 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c30ba-dc80-48df-a5c8-48a697f279a3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:41.543052 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37948868-c3b2-447e-8da9-0a885460bcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:41.544825 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37948868-c3b2-447e-8da9-0a885460bcfd admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:41.563751 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 480/971] 10.222.0.40 () {60 vars in 1483 bytes} [Sat Oct 29 20:42:41 2022] PUT /identity/v3/projects/a5f8451986d24caa9940cb7569a91951/users/3a5f5ceacaa44495bcf520ad9c3fb006/roles/9b15e747c88749bfb25139f3bd80b395 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 20:42:41.565506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 492/972] 10.222.0.40 () {58 vars in 1122 bytes} [Sat Oct 29 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 20:42:41.572767 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c30ba-dc80-48df-a5c8-48a697f279a3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:41.599505 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:42:41.672334 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c30ba-dc80-48df-a5c8-48a697f279a3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:41.677894 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d33099-9942-400d-9567-3243a221e256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:41.678692 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d33099-9942-400d-9567-3243a221e256 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:41.679038 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d33099-9942-400d-9567-3243a221e256 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:41.679598 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d33099-9942-400d-9567-3243a221e256 admin admin] PATH_INFO: `/v3/projects/ebeba3500afa4d7b8453f94ba8ccfb37/users/111a699675094bc89979195e7789b821/roles/9b15e747c88749bfb25139f3bd80b395` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:41.681533 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d33099-9942-400d-9567-3243a221e256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebeba3500afa4d7b8453f94ba8ccfb37, user_id=111a699675094bc89979195e7789b821, role_id=9b15e747c88749bfb25139f3bd80b395)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:41.684381 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d33099-9942-400d-9567-3243a221e256 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:41.696971 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 481/973] 10.222.0.40 () {60 vars in 1483 bytes} [Sat Oct 29 20:42:41 2022] PUT /identity/v3/projects/ebeba3500afa4d7b8453f94ba8ccfb37/users/111a699675094bc89979195e7789b821/roles/9b15e747c88749bfb25139f3bd80b395 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:42:48.095621 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeec396-3cb2-4b8b-8657-4c34b90c4d9a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:48.096464 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeec396-3cb2-4b8b-8657-4c34b90c4d9a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:48.096912 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeec396-3cb2-4b8b-8657-4c34b90c4d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:48.177860 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0aeec396-3cb2-4b8b-8657-4c34b90c4d9a None None] MFA Rules not processed for user `3a5f5ceacaa44495bcf520ad9c3fb006`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:48.179094 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0aeec396-3cb2-4b8b-8657-4c34b90c4d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:48.343748 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 493/974] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:42:48 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:42:48.346371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae11226-c06d-4aca-bc5c-e5d62d8c37d5 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:48.347255 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae11226-c06d-4aca-bc5c-e5d62d8c37d5 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:48.347779 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae11226-c06d-4aca-bc5c-e5d62d8c37d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:48.357854 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeec396-3cb2-4b8b-8657-4c34b90c4d9a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:48.360344 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0aeec396-3cb2-4b8b-8657-4c34b90c4d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:48.397838 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-cae11226-c06d-4aca-bc5c-e5d62d8c37d5 None None] MFA Rules not processed for user `111a699675094bc89979195e7789b821`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:48.400976 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cae11226-c06d-4aca-bc5c-e5d62d8c37d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:48.483508 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeec396-3cb2-4b8b-8657-4c34b90c4d9a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:48.487279 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79f468-4d3d-4fd0-929f-a114befeb40b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3f642ae91e04903ba8bba1eb8a1cea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:48.488154 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79f468-4d3d-4fd0-929f-a114befeb40b service glance] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:48.488592 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79f468-4d3d-4fd0-929f-a114befeb40b service glance] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:48.489014 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79f468-4d3d-4fd0-929f-a114befeb40b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:48.502643 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 482/975] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:42:48 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:42:48.517370 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae11226-c06d-4aca-bc5c-e5d62d8c37d5 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:48.519751 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cae11226-c06d-4aca-bc5c-e5d62d8c37d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:48.532217 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:42:48.543440 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae11226-c06d-4aca-bc5c-e5d62d8c37d5 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:48.548082 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbeb11-1a64-4011-9ed7-1805dac68108 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3f642ae91e04903ba8bba1eb8a1cea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:48.548908 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbeb11-1a64-4011-9ed7-1805dac68108 service glance] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:48.549366 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbeb11-1a64-4011-9ed7-1805dac68108 service glance] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:48.550449 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbeb11-1a64-4011-9ed7-1805dac68108 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:48.585346 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79f468-4d3d-4fd0-929f-a114befeb40b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:48.588821 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79f468-4d3d-4fd0-929f-a114befeb40b service glance] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:48.603735 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 494/976] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:42:48 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:42:48.650940 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbeb11-1a64-4011-9ed7-1805dac68108 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:48.652794 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbeb11-1a64-4011-9ed7-1805dac68108 service glance] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:48.674101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 483/977] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:42:48 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:42:57.325183 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bf658-73bf-483c-96b5-5d3dd6e6775f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:57.325753 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bf658-73bf-483c-96b5-5d3dd6e6775f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:57.325753 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bf658-73bf-483c-96b5-5d3dd6e6775f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:57.346741 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ba4bf658-73bf-483c-96b5-5d3dd6e6775f None None] MFA Rules not processed for user `97f5d7ad683243d198dbe96a2a6222ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:57.348228 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ba4bf658-73bf-483c-96b5-5d3dd6e6775f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:57.357078 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 495/978] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:42:57 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:42:57.648476 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae76abd-1729-4a89-a533-eb3a638c065f None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:57.649450 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae76abd-1729-4a89-a533-eb3a638c065f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:57.649450 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae76abd-1729-4a89-a533-eb3a638c065f None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:57.650516 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 484/979] 10.222.0.40 () {54 vars in 961 bytes} [Sat Oct 29 20:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:42:57.657006 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41013fbd-3547-4772-ae7d-84f51d6091ad None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:57.657366 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41013fbd-3547-4772-ae7d-84f51d6091ad None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:57.657723 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41013fbd-3547-4772-ae7d-84f51d6091ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:57.691100 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-41013fbd-3547-4772-ae7d-84f51d6091ad None None] MFA Rules not processed for user `b61b58116d364480aed22b5715f6a78a`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:57.692954 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-41013fbd-3547-4772-ae7d-84f51d6091ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:57.757311 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 496/980] 10.222.0.40 () {58 vars in 1058 bytes} [Sat Oct 29 20:42:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:42:57.762825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca1771-3947-4f8b-a73a-bcddb8550740 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:57.763107 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca1771-3947-4f8b-a73a-bcddb8550740 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:57.763420 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca1771-3947-4f8b-a73a-bcddb8550740 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:57.764722 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 485/981] 10.222.0.40 () {54 vars in 912 bytes} [Sat Oct 29 20:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:42:57.769720 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0251-6ef2-4653-b091-f48c1241677b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:57.770007 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0251-6ef2-4653-b091-f48c1241677b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:57.770290 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0251-6ef2-4653-b091-f48c1241677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:57.792808 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-d55e0251-6ef2-4653-b091-f48c1241677b None None] MFA Rules not processed for user `b61b58116d364480aed22b5715f6a78a`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:57.794056 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d55e0251-6ef2-4653-b091-f48c1241677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:57.807193 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 497/982] 10.222.0.40 () {58 vars in 1009 bytes} [Sat Oct 29 20:42:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:42:57.814387 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca1771-3947-4f8b-a73a-bcddb8550740 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:57.826091 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca1771-3947-4f8b-a73a-bcddb8550740 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:57.829728 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41712797-fd67-4a75-b877-10b2346818b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3f642ae91e04903ba8bba1eb8a1cea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:57.830258 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41712797-fd67-4a75-b877-10b2346818b8 service glance] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:57.830534 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41712797-fd67-4a75-b877-10b2346818b8 service glance] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:57.830803 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41712797-fd67-4a75-b877-10b2346818b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:57.840868 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41712797-fd67-4a75-b877-10b2346818b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:57.842299 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41712797-fd67-4a75-b877-10b2346818b8 service glance] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:57.852473 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 486/983] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:42:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 20:42:58.355361 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721f94-8cd7-47c5-a146-c6956e784b18 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:58.355886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721f94-8cd7-47c5-a146-c6956e784b18 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:58.355886 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721f94-8cd7-47c5-a146-c6956e784b18 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:58.357254 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 498/984] 10.222.0.40 () {54 vars in 912 bytes} [Sat Oct 29 20:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:42:58.362684 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f648eb-ee1b-4123-8c34-a79b763425eb None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:58.362963 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f648eb-ee1b-4123-8c34-a79b763425eb None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:58.363234 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f648eb-ee1b-4123-8c34-a79b763425eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:58.396942 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-21f648eb-ee1b-4123-8c34-a79b763425eb None None] MFA Rules not processed for user `d1a02361a67a4e40b4683042a4439204`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:58.398136 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-21f648eb-ee1b-4123-8c34-a79b763425eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:58.403614 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:42:58.466701 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 487/985] 10.222.0.40 () {58 vars in 1009 bytes} [Sat Oct 29 20:42:58 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:42:58.478491 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f721f94-8cd7-47c5-a146-c6956e784b18 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:58.490266 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f721f94-8cd7-47c5-a146-c6956e784b18 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:58.494263 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055cc8d-7f36-427a-8d99-c73b904cfb0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:58.495034 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055cc8d-7f36-427a-8d99-c73b904cfb0c service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:58.495358 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055cc8d-7f36-427a-8d99-c73b904cfb0c service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:58.495639 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055cc8d-7f36-427a-8d99-c73b904cfb0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:58.506830 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055cc8d-7f36-427a-8d99-c73b904cfb0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:58.508346 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055cc8d-7f36-427a-8d99-c73b904cfb0c service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:58.518301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 499/986] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:42:58 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:42:58.926193 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5d72-558c-4277-bd97-587e9a213864 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:58.926806 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5d72-558c-4277-bd97-587e9a213864 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:58.927039 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5d72-558c-4277-bd97-587e9a213864 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:58.928491 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 488/987] 10.222.0.40 () {54 vars in 961 bytes} [Sat Oct 29 20:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:42:58.941725 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ccd15-2c9e-45e9-a056-b41d086bc885 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:58.942059 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ccd15-2c9e-45e9-a056-b41d086bc885 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:58.942340 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ccd15-2c9e-45e9-a056-b41d086bc885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:58.953117 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d5d72-558c-4277-bd97-587e9a213864 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:58.965555 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-fd8ccd15-2c9e-45e9-a056-b41d086bc885 None None] MFA Rules not processed for user `b61b58116d364480aed22b5715f6a78a`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:58.966843 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-fd8ccd15-2c9e-45e9-a056-b41d086bc885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:58.977590 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 500/988] 10.222.0.40 () {58 vars in 1058 bytes} [Sat Oct 29 20:42:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:42:58.983370 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbffd7-3cf5-456c-b81e-ab4d4ec2e0bc None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:58.983759 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbffd7-3cf5-456c-b81e-ab4d4ec2e0bc None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:58.984133 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbffd7-3cf5-456c-b81e-ab4d4ec2e0bc None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:58.985679 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 501/989] 10.222.0.40 () {54 vars in 912 bytes} [Sat Oct 29 20:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 20:42:58.991590 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ba77-6ddf-4778-ad9d-b8813012fe17 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:58.992049 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ba77-6ddf-4778-ad9d-b8813012fe17 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:58.992515 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ba77-6ddf-4778-ad9d-b8813012fe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:59.014652 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7dc5ba77-6ddf-4778-ad9d-b8813012fe17 None None] MFA Rules not processed for user `b61b58116d364480aed22b5715f6a78a`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:42:59.015876 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7dc5ba77-6ddf-4778-ad9d-b8813012fe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:59.027664 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 502/990] 10.222.0.40 () {58 vars in 1009 bytes} [Sat Oct 29 20:42:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:42:59.035598 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d5d72-558c-4277-bd97-587e9a213864 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:59.041505 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5ba77-6ddf-4778-ad9d-b8813012fe17 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:42:59.042901 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5df0b4-e962-4045-9441-c85b493f74e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd70c0c1dd66244b68052c278d9b39dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:59.043553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5df0b4-e962-4045-9441-c85b493f74e4 service placement] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:59.043827 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5df0b4-e962-4045-9441-c85b493f74e4 service placement] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:59.044094 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5df0b4-e962-4045-9441-c85b493f74e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:59.045797 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2a5df0b4-e962-4045-9441-c85b493f74e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:42:59.051748 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5ba77-6ddf-4778-ad9d-b8813012fe17 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:42:59.056768 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5697230-85dc-46be-9a9f-02831fa2fbc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:42:59.057402 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5697230-85dc-46be-9a9f-02831fa2fbc0 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:42:59.058139 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5697230-85dc-46be-9a9f-02831fa2fbc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:42:59.058139 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5697230-85dc-46be-9a9f-02831fa2fbc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:42:59.060313 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5df0b4-e962-4045-9441-c85b493f74e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:59.061949 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5df0b4-e962-4045-9441-c85b493f74e4 service placement] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:59.070618 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5697230-85dc-46be-9a9f-02831fa2fbc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:42:59.072135 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5697230-85dc-46be-9a9f-02831fa2fbc0 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:42:59.075142 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 489/991] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:42:58 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 20:42:59.088169 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 503/992] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:42:59 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 20:43:08.514175 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a29aab-c6ff-4dc0-b5a2-d118eb062ed6 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:08.514696 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a29aab-c6ff-4dc0-b5a2-d118eb062ed6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:08.514796 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a29aab-c6ff-4dc0-b5a2-d118eb062ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:08.536316 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-00a29aab-c6ff-4dc0-b5a2-d118eb062ed6 None None] MFA Rules not processed for user `d1a02361a67a4e40b4683042a4439204`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:43:08.538599 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-00a29aab-c6ff-4dc0-b5a2-d118eb062ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:43:08.546908 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 490/993] 10.222.0.25 () {58 vars in 1015 bytes} [Sat Oct 29 20:43:08 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:43:08.559461 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5697230-85dc-46be-9a9f-02831fa2fbc0 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:43:08.570908 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5697230-85dc-46be-9a9f-02831fa2fbc0 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:43:08.574876 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cdbe2-1daf-4187-928a-0a81ed08a646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:43:08.575537 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cdbe2-1daf-4187-928a-0a81ed08a646 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:08.575831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cdbe2-1daf-4187-928a-0a81ed08a646 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:08.576070 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cdbe2-1daf-4187-928a-0a81ed08a646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:08.585754 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cdbe2-1daf-4187-928a-0a81ed08a646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:43:08.587205 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cdbe2-1daf-4187-928a-0a81ed08a646 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:43:08.598216 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 504/994] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:43:08 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:43:09.528783 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7ed88-ea7c-4b94-ba0a-3da2b7eb8c7d None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:09.529396 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7ed88-ea7c-4b94-ba0a-3da2b7eb8c7d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:09.529754 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7ed88-ea7c-4b94-ba0a-3da2b7eb8c7d None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:09.531179 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 491/995] 10.222.0.40 () {54 vars in 921 bytes} [Sat Oct 29 20:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:43:09.594677 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aa9f6-4be2-4a71-9b27-3a1de6e19030 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:09.595240 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aa9f6-4be2-4a71-9b27-3a1de6e19030 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:09.595240 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aa9f6-4be2-4a71-9b27-3a1de6e19030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:09.617244 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a70aa9f6-4be2-4a71-9b27-3a1de6e19030 None None] MFA Rules not processed for user `b61b58116d364480aed22b5715f6a78a`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:43:09.618704 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a70aa9f6-4be2-4a71-9b27-3a1de6e19030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:43:09.628310 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 505/996] 10.222.0.40 () {58 vars in 1018 bytes} [Sat Oct 29 20:43:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:43:09.645253 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7ed88-ea7c-4b94-ba0a-3da2b7eb8c7d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:43:09.663202 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7ed88-ea7c-4b94-ba0a-3da2b7eb8c7d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:43:09.668448 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4465c4-7015-4042-bd56-f2c7e98fd828 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:43:09.669044 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4465c4-7015-4042-bd56-f2c7e98fd828 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:09.669324 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4465c4-7015-4042-bd56-f2c7e98fd828 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:09.669595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4465c4-7015-4042-bd56-f2c7e98fd828 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:09.678593 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4465c4-7015-4042-bd56-f2c7e98fd828 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:43:09.680222 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4465c4-7015-4042-bd56-f2c7e98fd828 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:43:09.690310 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 492/997] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:43:09 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:43:15.066747 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a9cc-c25a-44a7-a04f-8e26861c29ff None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:15.067488 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a9cc-c25a-44a7-a04f-8e26861c29ff None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:15.067488 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a9cc-c25a-44a7-a04f-8e26861c29ff None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:15.069352 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 506/998] 10.222.0.40 () {54 vars in 921 bytes} [Sat Oct 29 20:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:43:15.079260 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e7851-c173-4f70-960d-7df9051df296 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:15.079777 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e7851-c173-4f70-960d-7df9051df296 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:15.079887 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e7851-c173-4f70-960d-7df9051df296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:15.102000 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b00e7851-c173-4f70-960d-7df9051df296 None None] MFA Rules not processed for user `b61b58116d364480aed22b5715f6a78a`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:43:15.107628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b00e7851-c173-4f70-960d-7df9051df296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:43:15.112634 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 493/999] 10.222.0.40 () {58 vars in 1018 bytes} [Sat Oct 29 20:43:15 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:43:15.123959 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5a9cc-c25a-44a7-a04f-8e26861c29ff None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:43:15.138711 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5a9cc-c25a-44a7-a04f-8e26861c29ff None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:43:15.143846 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aeeeab-2df0-477d-bbca-6eaa168dd4ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:43:15.144683 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeeeab-2df0-477d-bbca-6eaa168dd4ce service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:15.145039 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeeeab-2df0-477d-bbca-6eaa168dd4ce service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:15.145374 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeeeab-2df0-477d-bbca-6eaa168dd4ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:15.154904 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aeeeab-2df0-477d-bbca-6eaa168dd4ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:43:15.156521 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aeeeab-2df0-477d-bbca-6eaa168dd4ce service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:43:15.169038 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 507/1000] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:43:15 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:43:25.096207 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=62 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:43:25.162714 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=88 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:43:27.330933 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e7851-c173-4f70-960d-7df9051df296 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:43:27.341016 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e7851-c173-4f70-960d-7df9051df296 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:43:27.344628 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478bda6-4314-44bd-bb82-eac1bdb651f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:43:27.345211 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478bda6-4314-44bd-bb82-eac1bdb651f7 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:27.345482 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478bda6-4314-44bd-bb82-eac1bdb651f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:27.345747 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478bda6-4314-44bd-bb82-eac1bdb651f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:27.355808 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478bda6-4314-44bd-bb82-eac1bdb651f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:43:27.357236 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478bda6-4314-44bd-bb82-eac1bdb651f7 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:43:27.366734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 494/1001] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:43:27 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:43:29.405905 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef6ea5-5ecd-469d-a93b-d4d87f151f80 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:29.406458 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef6ea5-5ecd-469d-a93b-d4d87f151f80 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:29.406556 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef6ea5-5ecd-469d-a93b-d4d87f151f80 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:29.408416 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 508/1002] 10.222.0.40 () {54 vars in 921 bytes} [Sat Oct 29 20:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:43:29.414337 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafda012-10fb-41ac-b621-82256cb7a57c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:29.414876 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafda012-10fb-41ac-b621-82256cb7a57c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:29.415132 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafda012-10fb-41ac-b621-82256cb7a57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:29.438088 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-cafda012-10fb-41ac-b621-82256cb7a57c None None] MFA Rules not processed for user `b61b58116d364480aed22b5715f6a78a`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:43:29.439672 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cafda012-10fb-41ac-b621-82256cb7a57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:43:29.455649 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 495/1003] 10.222.0.40 () {58 vars in 1018 bytes} [Sat Oct 29 20:43:29 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:43:29.466574 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef6ea5-5ecd-469d-a93b-d4d87f151f80 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:43:29.483010 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef6ea5-5ecd-469d-a93b-d4d87f151f80 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:43:29.488965 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686e9a8-d82a-4d19-9623-92232ffa8993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:43:29.490230 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686e9a8-d82a-4d19-9623-92232ffa8993 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:29.490509 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686e9a8-d82a-4d19-9623-92232ffa8993 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:29.490970 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686e9a8-d82a-4d19-9623-92232ffa8993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:29.502014 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686e9a8-d82a-4d19-9623-92232ffa8993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:43:29.504150 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686e9a8-d82a-4d19-9623-92232ffa8993 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:43:29.516985 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 509/1004] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:43:29 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:43:39.431916 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=9 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:43:39.512357 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=6 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:43:47.450801 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc99ff-6d89-433c-a345-3bc2af93a8d3 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:47.451376 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc99ff-6d89-433c-a345-3bc2af93a8d3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:47.451376 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc99ff-6d89-433c-a345-3bc2af93a8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:47.470349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b4bc99ff-6d89-433c-a345-3bc2af93a8d3 None None] MFA Rules not processed for user `7edf42866be642adb953dffe093f386b`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:43:47.471553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b4bc99ff-6d89-433c-a345-3bc2af93a8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:43:47.479199 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 496/1005] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:43:47 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:43:47.782941 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6630d3-bf6a-4e4b-b1e3-f249ac74b960 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:47.783489 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6630d3-bf6a-4e4b-b1e3-f249ac74b960 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:47.783592 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6630d3-bf6a-4e4b-b1e3-f249ac74b960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:47.803562 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9e6630d3-bf6a-4e4b-b1e3-f249ac74b960 None None] MFA Rules not processed for user `d1a02361a67a4e40b4683042a4439204`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:43:47.804769 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9e6630d3-bf6a-4e4b-b1e3-f249ac74b960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:43:47.811094 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 510/1006] 10.222.0.40 () {58 vars in 1009 bytes} [Sat Oct 29 20:43:47 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:43:47.823059 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc99ff-6d89-433c-a345-3bc2af93a8d3 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:43:47.832372 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc99ff-6d89-433c-a345-3bc2af93a8d3 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:43:47.836434 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9769d3-3d54-4767-a4b5-253850d3f5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:43:47.837014 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9769d3-3d54-4767-a4b5-253850d3f5bf service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:43:47.837284 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9769d3-3d54-4767-a4b5-253850d3f5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:43:47.837551 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9769d3-3d54-4767-a4b5-253850d3f5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:43:47.844311 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9769d3-3d54-4767-a4b5-253850d3f5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:43:47.845707 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9769d3-3d54-4767-a4b5-253850d3f5bf service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:43:47.853508 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 497/1007] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:43:47 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:43:57.798324 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:43:57.850028 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=9 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:44:12.610800 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed102b-03ab-47c0-90b3-39cb3ef48f4c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:44:12.611339 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed102b-03ab-47c0-90b3-39cb3ef48f4c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:44:12.611436 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed102b-03ab-47c0-90b3-39cb3ef48f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:44:12.630043 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0aed102b-03ab-47c0-90b3-39cb3ef48f4c None None] MFA Rules not processed for user `7edf42866be642adb953dffe093f386b`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:44:12.631231 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0aed102b-03ab-47c0-90b3-39cb3ef48f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:44:12.638729 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 511/1008] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:44:12 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:44:22.625333 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:44:26.057008 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e925c5-8089-4c3b-86bb-721937b3042c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:44:26.057483 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e925c5-8089-4c3b-86bb-721937b3042c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:44:26.057590 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e925c5-8089-4c3b-86bb-721937b3042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:44:26.076603 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b4e925c5-8089-4c3b-86bb-721937b3042c None None] MFA Rules not processed for user `7edf42866be642adb953dffe093f386b`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:44:26.077786 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b4e925c5-8089-4c3b-86bb-721937b3042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:44:26.084504 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 498/1009] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:44:26 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:44:36.071682 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:45:22.158049 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4ab4c-2361-4670-8ebb-0192bd80f395 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:45:22.158531 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4ab4c-2361-4670-8ebb-0192bd80f395 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:45:22.158640 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4ab4c-2361-4670-8ebb-0192bd80f395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:45:22.177567 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-19a4ab4c-2361-4670-8ebb-0192bd80f395 None None] MFA Rules not processed for user `7edf42866be642adb953dffe093f386b`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:45:22.178755 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-19a4ab4c-2361-4670-8ebb-0192bd80f395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:45:22.185457 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 512/1010] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:45:22 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:45:32.172445 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:45:34.887097 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e925c5-8089-4c3b-86bb-721937b3042c None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:45:34.906404 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e925c5-8089-4c3b-86bb-721937b3042c None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:45:34.909960 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8be88-ddaf-4fec-b496-2386a4bcd888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:45:34.910561 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8be88-ddaf-4fec-b496-2386a4bcd888 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:45:34.910839 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8be88-ddaf-4fec-b496-2386a4bcd888 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:45:34.911111 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8be88-ddaf-4fec-b496-2386a4bcd888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:45:34.919997 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8be88-ddaf-4fec-b496-2386a4bcd888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:45:34.921705 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8be88-ddaf-4fec-b496-2386a4bcd888 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:45:34.931540 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 499/1011] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:45:34 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:45:44.927358 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=10 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:46:57.208863 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4ab4c-2361-4670-8ebb-0192bd80f395 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:46:57.230182 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4ab4c-2361-4670-8ebb-0192bd80f395 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:46:57.235117 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91d5a2-801d-4c79-a659-7887101a013b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd70c0c1dd66244b68052c278d9b39dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:46:57.235740 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91d5a2-801d-4c79-a659-7887101a013b service placement] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:46:57.236015 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91d5a2-801d-4c79-a659-7887101a013b service placement] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:46:57.236284 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91d5a2-801d-4c79-a659-7887101a013b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:46:57.245764 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91d5a2-801d-4c79-a659-7887101a013b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:46:57.247385 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91d5a2-801d-4c79-a659-7887101a013b service placement] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:46:57.257247 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 513/1012] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:46:57 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:47:07.253236 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=10 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:19.130793 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce19e6-c7e8-46b4-a8c2-b0f7d70d596f None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:47:19.131292 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce19e6-c7e8-46b4-a8c2-b0f7d70d596f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:47:19.131406 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce19e6-c7e8-46b4-a8c2-b0f7d70d596f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:47:19.151101 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9cce19e6-c7e8-46b4-a8c2-b0f7d70d596f None None] MFA Rules not processed for user `97f5d7ad683243d198dbe96a2a6222ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:47:19.152307 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9cce19e6-c7e8-46b4-a8c2-b0f7d70d596f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:47:19.158979 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 500/1013] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:47:19 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:47:29.145217 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:45.628682 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee9d3c-836c-4c01-81fa-07b0225a701c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:47:45.629233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee9d3c-836c-4c01-81fa-07b0225a701c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:47:45.629233 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee9d3c-836c-4c01-81fa-07b0225a701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:47:45.650187 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-05ee9d3c-836c-4c01-81fa-07b0225a701c None None] MFA Rules not processed for user `7edf42866be642adb953dffe093f386b`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:47:45.651449 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-05ee9d3c-836c-4c01-81fa-07b0225a701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:47:45.659090 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 514/1014] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:47:45 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:47:48.075736 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce19e6-c7e8-46b4-a8c2-b0f7d70d596f None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:47:48.082896 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee9d3c-836c-4c01-81fa-07b0225a701c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:47:48.086660 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce19e6-c7e8-46b4-a8c2-b0f7d70d596f None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:47:48.090389 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a8499-2161-45aa-9451-46579594f296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:47:48.091222 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a8499-2161-45aa-9451-46579594f296 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:47:48.091697 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a8499-2161-45aa-9451-46579594f296 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:47:48.092121 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a8499-2161-45aa-9451-46579594f296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:47:48.102797 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a8499-2161-45aa-9451-46579594f296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:47:48.104656 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a8499-2161-45aa-9451-46579594f296 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:47:48.125715 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 501/1015] 10.222.0.40 () {60 vars in 1396 bytes} [Sat Oct 29 20:47:48 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2820 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 20:47:48.156355 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a8499-2161-45aa-9451-46579594f296 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:47:48.172951 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a8499-2161-45aa-9451-46579594f296 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:47:48.183746 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d9319-1e75-43f7-8ed0-fca61ada6fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:47:48.184349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d9319-1e75-43f7-8ed0-fca61ada6fcd service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:47:48.184624 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d9319-1e75-43f7-8ed0-fca61ada6fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:47:48.185058 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d9319-1e75-43f7-8ed0-fca61ada6fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:47:48.194177 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee9d3c-836c-4c01-81fa-07b0225a701c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:47:48.199540 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47ad38-7b7d-4bd5-a38f-e2df2bb3f1c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a21be7abe924b459ffe156f914e6ff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:47:48.200379 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47ad38-7b7d-4bd5-a38f-e2df2bb3f1c8 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:47:48.200888 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47ad38-7b7d-4bd5-a38f-e2df2bb3f1c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:47:48.201395 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47ad38-7b7d-4bd5-a38f-e2df2bb3f1c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:47:48.203266 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d9319-1e75-43f7-8ed0-fca61ada6fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:47:48.204984 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d9319-1e75-43f7-8ed0-fca61ada6fcd service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:47:48.211889 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47ad38-7b7d-4bd5-a38f-e2df2bb3f1c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:47:48.213903 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47ad38-7b7d-4bd5-a38f-e2df2bb3f1c8 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:47:48.225112 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 515/1016] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:47:48 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 20:47:48.229599 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 502/1017] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:47:48 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:47:58.219357 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=12 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:58.219953 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=33 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:11.954081 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47ad38-7b7d-4bd5-a38f-e2df2bb3f1c8 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:48:11.956066 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d9319-1e75-43f7-8ed0-fca61ada6fcd service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:48:11.964399 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47ad38-7b7d-4bd5-a38f-e2df2bb3f1c8 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:48:11.965223 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d9319-1e75-43f7-8ed0-fca61ada6fcd service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:48:11.968114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b7494-0c20-4607-b65a-8e8be2324be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:48:11.968787 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b7494-0c20-4607-b65a-8e8be2324be1 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:48:11.968889 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502746fe-d6b3-4765-85df-739da0db232c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:48:11.969185 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b7494-0c20-4607-b65a-8e8be2324be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:48:11.969398 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502746fe-d6b3-4765-85df-739da0db232c service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:48:11.969591 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b7494-0c20-4607-b65a-8e8be2324be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:48:11.969687 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502746fe-d6b3-4765-85df-739da0db232c service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:48:11.969928 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502746fe-d6b3-4765-85df-739da0db232c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:48:11.977824 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502746fe-d6b3-4765-85df-739da0db232c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:48:11.979254 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502746fe-d6b3-4765-85df-739da0db232c service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:48:11.979869 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b7494-0c20-4607-b65a-8e8be2324be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:48:11.981300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b7494-0c20-4607-b65a-8e8be2324be1 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:48:11.987107 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 503/1018] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:48:11 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 20:48:12.001507 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 516/1019] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:48:11 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:48:13.210142 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502746fe-d6b3-4765-85df-739da0db232c service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:48:13.219170 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502746fe-d6b3-4765-85df-739da0db232c service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:48:13.222781 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa06a79-4015-4fda-9304-707c8d6a29fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:48:13.223409 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa06a79-4015-4fda-9304-707c8d6a29fd service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:48:13.223729 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa06a79-4015-4fda-9304-707c8d6a29fd service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:48:13.224000 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa06a79-4015-4fda-9304-707c8d6a29fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:48:13.233919 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa06a79-4015-4fda-9304-707c8d6a29fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:48:13.235362 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa06a79-4015-4fda-9304-707c8d6a29fd service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:48:13.245814 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 504/1020] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:48:13 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:48:21.998750 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=10 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:23.241027 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=12 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:56.910861 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b7494-0c20-4607-b65a-8e8be2324be1 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:48:56.931929 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b7494-0c20-4607-b65a-8e8be2324be1 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:48:56.941648 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd664762-493f-438e-b6ea-48732d13cbf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:48:56.942357 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd664762-493f-438e-b6ea-48732d13cbf5 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:48:56.942660 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd664762-493f-438e-b6ea-48732d13cbf5 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:48:56.943039 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd664762-493f-438e-b6ea-48732d13cbf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:48:56.954313 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd664762-493f-438e-b6ea-48732d13cbf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:48:56.956698 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd664762-493f-438e-b6ea-48732d13cbf5 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:48:56.971171 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 517/1021] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:48:56 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:49:03.359472 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa06a79-4015-4fda-9304-707c8d6a29fd service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:49:03.381880 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa06a79-4015-4fda-9304-707c8d6a29fd service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:49:03.388197 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a5554-9ca5-4cc1-82e4-18c880c9dfb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:49:03.388964 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a5554-9ca5-4cc1-82e4-18c880c9dfb7 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:03.389296 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a5554-9ca5-4cc1-82e4-18c880c9dfb7 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:03.389568 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a5554-9ca5-4cc1-82e4-18c880c9dfb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:03.398715 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a5554-9ca5-4cc1-82e4-18c880c9dfb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:49:03.400332 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a5554-9ca5-4cc1-82e4-18c880c9dfb7 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:49:03.410446 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 505/1022] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:49:03 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:49:04.883620 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd664762-493f-438e-b6ea-48732d13cbf5 service nova] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:49:04.892673 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd664762-493f-438e-b6ea-48732d13cbf5 service nova] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:49:04.896138 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9c3e1-819f-4455-8bf6-c620403e0503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:49:04.897235 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9c3e1-819f-4455-8bf6-c620403e0503 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:04.898073 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9c3e1-819f-4455-8bf6-c620403e0503 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:04.898350 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9c3e1-819f-4455-8bf6-c620403e0503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:04.958001 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9c3e1-819f-4455-8bf6-c620403e0503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:49:04.960437 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9c3e1-819f-4455-8bf6-c620403e0503 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:49:04.979653 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 518/1023] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:49:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:49:08.296265 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c1c3b-a115-4d2b-b409-70c0b8615caf None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:08.296729 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c1c3b-a115-4d2b-b409-70c0b8615caf None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:08.296833 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c1c3b-a115-4d2b-b409-70c0b8615caf None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:08.298154 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 506/1024] 10.222.0.40 () {54 vars in 921 bytes} [Sat Oct 29 20:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:49:08.308197 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba2c40-b754-4378-9e96-89ea7b89d18b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:08.308649 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba2c40-b754-4378-9e96-89ea7b89d18b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:08.308928 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba2c40-b754-4378-9e96-89ea7b89d18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:08.372707 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-18ba2c40-b754-4378-9e96-89ea7b89d18b None None] MFA Rules not processed for user `d70c0c1dd66244b68052c278d9b39dce`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:49:08.372809 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-18ba2c40-b754-4378-9e96-89ea7b89d18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:49:08.389060 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 519/1025] 10.222.0.40 () {58 vars in 1018 bytes} [Sat Oct 29 20:49:08 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:49:08.400531 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c1c3b-a115-4d2b-b409-70c0b8615caf None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:49:08.414311 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c1c3b-a115-4d2b-b409-70c0b8615caf None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:49:08.419361 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd15300-f0d2-4c21-8e70-eac1ea81c5cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd70c0c1dd66244b68052c278d9b39dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:49:08.420085 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd15300-f0d2-4c21-8e70-eac1ea81c5cb service placement] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:08.420427 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd15300-f0d2-4c21-8e70-eac1ea81c5cb service placement] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:08.420938 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd15300-f0d2-4c21-8e70-eac1ea81c5cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:08.430525 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd15300-f0d2-4c21-8e70-eac1ea81c5cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:49:08.432126 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd15300-f0d2-4c21-8e70-eac1ea81c5cb service placement] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:49:08.441712 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 507/1026] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:49:08 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:49:11.781714 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735b508-f442-4937-a39d-151eff52bac7 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:11.782168 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735b508-f442-4937-a39d-151eff52bac7 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:11.782370 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735b508-f442-4937-a39d-151eff52bac7 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:11.784016 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 520/1027] 10.222.0.40 () {54 vars in 921 bytes} [Sat Oct 29 20:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:49:11.795882 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab7b5c-b0b1-4b39-a2e7-153a15c3e70b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:11.796324 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab7b5c-b0b1-4b39-a2e7-153a15c3e70b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:11.796419 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab7b5c-b0b1-4b39-a2e7-153a15c3e70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:11.817842 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b8ab7b5c-b0b1-4b39-a2e7-153a15c3e70b None None] MFA Rules not processed for user `d70c0c1dd66244b68052c278d9b39dce`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:49:11.820087 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b8ab7b5c-b0b1-4b39-a2e7-153a15c3e70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:49:11.831791 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 508/1028] 10.222.0.40 () {58 vars in 1018 bytes} [Sat Oct 29 20:49:11 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 20:49:11.848651 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735b508-f442-4937-a39d-151eff52bac7 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:49:11.867776 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735b508-f442-4937-a39d-151eff52bac7 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:49:11.868673 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab7b5c-b0b1-4b39-a2e7-153a15c3e70b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:49:11.875000 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761c6bf-f4ae-4d6f-9a9d-a35f399183a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd70c0c1dd66244b68052c278d9b39dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:49:11.876852 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761c6bf-f4ae-4d6f-9a9d-a35f399183a6 service placement] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:11.877757 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761c6bf-f4ae-4d6f-9a9d-a35f399183a6 service placement] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:11.878193 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761c6bf-f4ae-4d6f-9a9d-a35f399183a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:11.888831 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab7b5c-b0b1-4b39-a2e7-153a15c3e70b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:49:11.889774 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761c6bf-f4ae-4d6f-9a9d-a35f399183a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:49:11.892621 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761c6bf-f4ae-4d6f-9a9d-a35f399183a6 service placement] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:49:11.893926 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0467c-de61-448b-be3b-4532d7c5cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:49:11.894553 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0467c-de61-448b-be3b-4532d7c5cf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:11.894914 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0467c-de61-448b-be3b-4532d7c5cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:11.895080 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0467c-de61-448b-be3b-4532d7c5cf5a admin admin] PATH_INFO: `/v3/users/97f5d7ad683243d198dbe96a2a6222ce` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:11.899519 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0467c-de61-448b-be3b-4532d7c5cf5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f5d7ad683243d198dbe96a2a6222ce)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:49:11.901998 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0467c-de61-448b-be3b-4532d7c5cf5a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:49:11.905023 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 521/1029] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:49:11 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:49:11.954255 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-efa0467c-de61-448b-be3b-4532d7c5cf5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f5d7ad683243d198dbe96a2a6222ce'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:11.966349 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-efa0467c-de61-448b-be3b-4532d7c5cf5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f5d7ad683243d198dbe96a2a6222ce'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:11.973404 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-efa0467c-de61-448b-be3b-4532d7c5cf5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f5d7ad683243d198dbe96a2a6222ce'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:11.974099 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-efa0467c-de61-448b-be3b-4532d7c5cf5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f5d7ad683243d198dbe96a2a6222ce'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:11.982611 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-efa0467c-de61-448b-be3b-4532d7c5cf5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f5d7ad683243d198dbe96a2a6222ce'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:11.988497 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 509/1030] 10.222.0.40 () {58 vars in 1224 bytes} [Sat Oct 29 20:49:11 2022] DELETE /identity/v3/users/97f5d7ad683243d198dbe96a2a6222ce => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:49:12.168496 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761c6bf-f4ae-4d6f-9a9d-a35f399183a6 service placement] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:49:12.180746 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761c6bf-f4ae-4d6f-9a9d-a35f399183a6 service placement] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:49:12.242047 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:49:12.242682 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:12.242957 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:12.243223 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] PATH_INFO: `/v3/projects/733f5da028894904abdd4ffb3d54e625` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:12.244380 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] RBAC: Authorizing `identity:delete_project(project_id=733f5da028894904abdd4ffb3d54e625)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:49:12.246301 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:49:12.269607 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:12.293755 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733f5da028894904abdd4ffb3d54e625', 'request_id': 'req-ab9c336c-d746-4d11-b2a6-79b38d0f443c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.299721 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733f5da028894904abdd4ffb3d54e625', 'request_id': 'req-ab9c336c-d746-4d11-b2a6-79b38d0f443c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.308270 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733f5da028894904abdd4ffb3d54e625', 'request_id': 'req-ab9c336c-d746-4d11-b2a6-79b38d0f443c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.319087 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] The token cache is being invalidate because project 733f5da028894904abdd4ffb3d54e625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 20:49:12.319445 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.320146 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.321690 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 522/1031] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:12 2022] DELETE /identity/v3/projects/733f5da028894904abdd4ffb3d54e625 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:49:12.325855 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0467c-de61-448b-be3b-4532d7c5cf5a admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:49:12.327288 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-efa0467c-de61-448b-be3b-4532d7c5cf5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:49:12.340945 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0467c-de61-448b-be3b-4532d7c5cf5a admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:49:12.395656 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091707fc-562f-402d-bdf1-58808ec0f89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:49:12.396272 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091707fc-562f-402d-bdf1-58808ec0f89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:12.396546 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091707fc-562f-402d-bdf1-58808ec0f89c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:12.396823 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091707fc-562f-402d-bdf1-58808ec0f89c admin admin] PATH_INFO: `/v3/users/3a5f5ceacaa44495bcf520ad9c3fb006` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:12.397918 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091707fc-562f-402d-bdf1-58808ec0f89c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5f5ceacaa44495bcf520ad9c3fb006)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:49:12.399863 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091707fc-562f-402d-bdf1-58808ec0f89c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:49:12.440230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:12.446755 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-091707fc-562f-402d-bdf1-58808ec0f89c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5f5ceacaa44495bcf520ad9c3fb006'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.459897 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-091707fc-562f-402d-bdf1-58808ec0f89c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5f5ceacaa44495bcf520ad9c3fb006'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.466558 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-091707fc-562f-402d-bdf1-58808ec0f89c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5f5ceacaa44495bcf520ad9c3fb006'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.467227 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-091707fc-562f-402d-bdf1-58808ec0f89c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5f5ceacaa44495bcf520ad9c3fb006'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.475184 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-091707fc-562f-402d-bdf1-58808ec0f89c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5f5ceacaa44495bcf520ad9c3fb006'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.480994 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 510/1032] 10.222.0.40 () {58 vars in 1224 bytes} [Sat Oct 29 20:49:12 2022] DELETE /identity/v3/users/3a5f5ceacaa44495bcf520ad9c3fb006 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:49:12.652518 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:49:12.653961 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:49:12.668448 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c336c-d746-4d11-b2a6-79b38d0f443c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:49:12.732279 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:49:12.732914 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:12.733216 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:12.733523 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] PATH_INFO: `/v3/projects/a5f8451986d24caa9940cb7569a91951` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:12.734726 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f8451986d24caa9940cb7569a91951)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:49:12.736716 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:49:12.785042 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f8451986d24caa9940cb7569a91951', 'request_id': 'req-8e4b5511-0569-44d1-b19c-15b396436cea'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.791065 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f8451986d24caa9940cb7569a91951', 'request_id': 'req-8e4b5511-0569-44d1-b19c-15b396436cea'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.803127 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f8451986d24caa9940cb7569a91951', 'request_id': 'req-8e4b5511-0569-44d1-b19c-15b396436cea'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.813594 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] The token cache is being invalidate because project a5f8451986d24caa9940cb7569a91951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 20:49:12.814052 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.814658 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:49:12.816174 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 523/1033] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:12 2022] DELETE /identity/v3/projects/a5f8451986d24caa9940cb7569a91951 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:49:22.477537 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=14,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:22.810505 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:39.890733 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392537c2-d741-4346-964a-ccd3657c1260 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:39.891289 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392537c2-d741-4346-964a-ccd3657c1260 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:39.891670 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392537c2-d741-4346-964a-ccd3657c1260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:39.913133 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-392537c2-d741-4346-964a-ccd3657c1260 None None] MFA Rules not processed for user `7edf42866be642adb953dffe093f386b`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:49:39.914322 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-392537c2-d741-4346-964a-ccd3657c1260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:49:39.970230 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 511/1034] 10.222.0.40 () {58 vars in 958 bytes} [Sat Oct 29 20:49:39 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:49:40.290603 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:49:40.292032 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:49:40.349009 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b5511-0569-44d1-b19c-15b396436cea admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:49:40.352674 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec12f5-7058-43ad-b308-e2b4f415b7c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:49:40.353445 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec12f5-7058-43ad-b308-e2b4f415b7c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:40.353729 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec12f5-7058-43ad-b308-e2b4f415b7c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:40.353997 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec12f5-7058-43ad-b308-e2b4f415b7c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:40.355720 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6dec12f5-7058-43ad-b308-e2b4f415b7c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:49:40.365528 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec12f5-7058-43ad-b308-e2b4f415b7c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:49:40.367109 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec12f5-7058-43ad-b308-e2b4f415b7c9 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:49:40.374776 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 524/1035] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:49:40 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:49:40.816187 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392537c2-d741-4346-964a-ccd3657c1260 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:49:40.817601 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-392537c2-d741-4346-964a-ccd3657c1260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:49:40.888426 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392537c2-d741-4346-964a-ccd3657c1260 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:49:40.894946 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98acd6-d1be-4ab6-bcaa-407b1dfad5c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd70c0c1dd66244b68052c278d9b39dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:49:40.895643 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98acd6-d1be-4ab6-bcaa-407b1dfad5c6 service placement] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:40.896457 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98acd6-d1be-4ab6-bcaa-407b1dfad5c6 service placement] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:40.896720 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98acd6-d1be-4ab6-bcaa-407b1dfad5c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:40.898610 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2b98acd6-d1be-4ab6-bcaa-407b1dfad5c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:49:40.910224 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98acd6-d1be-4ab6-bcaa-407b1dfad5c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:49:40.912660 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98acd6-d1be-4ab6-bcaa-407b1dfad5c6 service placement] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:49:40.922567 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 512/1036] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:49:40 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:49:50.371473 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=26 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:50.885203 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec12f5-7058-43ad-b308-e2b4f415b7c9 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:49:50.886706 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6dec12f5-7058-43ad-b308-e2b4f415b7c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:49:50.918328 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=57 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:50.963675 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec12f5-7058-43ad-b308-e2b4f415b7c9 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:49:50.968973 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4100c1e-3d30-4343-805d-904921d249a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61b58116d364480aed22b5715f6a78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:49:50.970114 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4100c1e-3d30-4343-805d-904921d249a8 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:49:50.970391 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4100c1e-3d30-4343-805d-904921d249a8 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:49:50.970662 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4100c1e-3d30-4343-805d-904921d249a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:49:50.972432 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f4100c1e-3d30-4343-805d-904921d249a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:49:50.984297 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4100c1e-3d30-4343-805d-904921d249a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:49:50.985813 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4100c1e-3d30-4343-805d-904921d249a8 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:49:50.996427 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 525/1037] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:49:50 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:50:00.992494 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=32 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:04.186451 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742806c-fc3f-4261-8b71-0fecd6834eeb None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:52:04.186861 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742806c-fc3f-4261-8b71-0fecd6834eeb None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:52:04.187025 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742806c-fc3f-4261-8b71-0fecd6834eeb None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:52:04.188415 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 513/1038] 10.222.0.40 () {54 vars in 961 bytes} [Sat Oct 29 20:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 20:52:04.194431 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea643-0ccd-4c45-959c-9896e24afb8a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:52:04.194889 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea643-0ccd-4c45-959c-9896e24afb8a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:52:04.194986 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea643-0ccd-4c45-959c-9896e24afb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:52:04.232406 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-cebea643-0ccd-4c45-959c-9896e24afb8a None None] MFA Rules not processed for user `d70c0c1dd66244b68052c278d9b39dce`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 20:52:04.233576 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-cebea643-0ccd-4c45-959c-9896e24afb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:52:04.286236 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 526/1039] 10.222.0.40 () {58 vars in 1058 bytes} [Sat Oct 29 20:52:04 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 20:52:04.295829 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742806c-fc3f-4261-8b71-0fecd6834eeb None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:52:04.309825 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742806c-fc3f-4261-8b71-0fecd6834eeb None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:52:04.315371 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7774c-6d55-4a17-9e6b-54a8152dd081 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd70c0c1dd66244b68052c278d9b39dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:52:04.315955 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7774c-6d55-4a17-9e6b-54a8152dd081 service placement] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:52:04.316231 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7774c-6d55-4a17-9e6b-54a8152dd081 service placement] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:52:04.316502 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7774c-6d55-4a17-9e6b-54a8152dd081 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:52:04.318189 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-22b7774c-6d55-4a17-9e6b-54a8152dd081 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:52:04.329237 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7774c-6d55-4a17-9e6b-54a8152dd081 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:52:04.330935 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7774c-6d55-4a17-9e6b-54a8152dd081 service placement] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:52:04.340621 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 514/1040] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:52:04 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:52:14.284579 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=29 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:14.336636 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=6 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:18.028018 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebea643-0ccd-4c45-959c-9896e24afb8a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:52:18.037960 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebea643-0ccd-4c45-959c-9896e24afb8a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:52:18.041506 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef9498-3f58-48ab-b1db-131374cfb91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a02361a67a4e40b4683042a4439204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c8029f1fc24cd098d360f54c51451d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:52:18.042095 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef9498-3f58-48ab-b1db-131374cfb91d service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:52:18.042393 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef9498-3f58-48ab-b1db-131374cfb91d service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:52:18.042645 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef9498-3f58-48ab-b1db-131374cfb91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:52:18.044369 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0bef9498-3f58-48ab-b1db-131374cfb91d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:52:18.130831 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef9498-3f58-48ab-b1db-131374cfb91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:52:18.132300 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef9498-3f58-48ab-b1db-131374cfb91d service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:52:18.141579 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 527/1041] 10.222.0.40 () {60 vars in 1365 bytes} [Sat Oct 29 20:52:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 20:52:24.555401 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7774c-6d55-4a17-9e6b-54a8152dd081 service placement] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:52:24.556944 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-22b7774c-6d55-4a17-9e6b-54a8152dd081 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:52:24.570425 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7774c-6d55-4a17-9e6b-54a8152dd081 service placement] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:52:24.575226 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d173a-17d6-4b06-963a-d9dc9f095db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:52:24.575956 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d173a-17d6-4b06-963a-d9dc9f095db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:52:24.576300 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d173a-17d6-4b06-963a-d9dc9f095db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:52:24.576577 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d173a-17d6-4b06-963a-d9dc9f095db9 admin admin] PATH_INFO: `/v3/users/7edf42866be642adb953dffe093f386b` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:52:24.577710 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d173a-17d6-4b06-963a-d9dc9f095db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7edf42866be642adb953dffe093f386b)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:52:24.580192 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d173a-17d6-4b06-963a-d9dc9f095db9 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:52:24.628003 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-068d173a-17d6-4b06-963a-d9dc9f095db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7edf42866be642adb953dffe093f386b'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:24.639694 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-068d173a-17d6-4b06-963a-d9dc9f095db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7edf42866be642adb953dffe093f386b'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:24.647062 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-068d173a-17d6-4b06-963a-d9dc9f095db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7edf42866be642adb953dffe093f386b'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:24.647760 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-068d173a-17d6-4b06-963a-d9dc9f095db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7edf42866be642adb953dffe093f386b'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:24.655040 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-068d173a-17d6-4b06-963a-d9dc9f095db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7edf42866be642adb953dffe093f386b'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:24.661436 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 515/1042] 10.222.0.40 () {58 vars in 1224 bytes} [Sat Oct 29 20:52:24 2022] DELETE /identity/v3/users/7edf42866be642adb953dffe093f386b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:52:24.842737 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef9498-3f58-48ab-b1db-131374cfb91d service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:52:24.858040 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef9498-3f58-48ab-b1db-131374cfb91d service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:52:24.919967 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:52:24.920596 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:52:24.920901 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:52:24.921171 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] PATH_INFO: `/v3/projects/824bd977af19499a87712ca58bef0448` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:52:24.922304 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824bd977af19499a87712ca58bef0448)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:52:24.924446 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:52:24.970020 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824bd977af19499a87712ca58bef0448', 'request_id': 'req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:24.976622 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824bd977af19499a87712ca58bef0448', 'request_id': 'req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:24.983842 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824bd977af19499a87712ca58bef0448', 'request_id': 'req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:24.994175 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] The token cache is being invalidate because project 824bd977af19499a87712ca58bef0448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 20:52:24.994457 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:24.995095 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:24.996839 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 528/1043] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Oct 29 20:52:24 2022] DELETE /identity/v3/projects/824bd977af19499a87712ca58bef0448 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:52:25.000765 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d173a-17d6-4b06-963a-d9dc9f095db9 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:52:25.003383 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-068d173a-17d6-4b06-963a-d9dc9f095db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:52:25.016279 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d173a-17d6-4b06-963a-d9dc9f095db9 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:52:25.073193 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9055c-edd1-4fb4-a810-d1f1de14724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:52:25.073841 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9055c-edd1-4fb4-a810-d1f1de14724a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:52:25.074118 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9055c-edd1-4fb4-a810-d1f1de14724a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:52:25.074386 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9055c-edd1-4fb4-a810-d1f1de14724a admin admin] PATH_INFO: `/v3/users/111a699675094bc89979195e7789b821` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:52:25.075557 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9055c-edd1-4fb4-a810-d1f1de14724a admin admin] RBAC: Authorizing `identity:delete_user(user_id=111a699675094bc89979195e7789b821)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:52:25.077462 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9055c-edd1-4fb4-a810-d1f1de14724a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:52:25.125449 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-13a9055c-edd1-4fb4-a810-d1f1de14724a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111a699675094bc89979195e7789b821'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:25.137247 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-13a9055c-edd1-4fb4-a810-d1f1de14724a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111a699675094bc89979195e7789b821'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:25.144340 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-13a9055c-edd1-4fb4-a810-d1f1de14724a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111a699675094bc89979195e7789b821'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:25.145002 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-13a9055c-edd1-4fb4-a810-d1f1de14724a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111a699675094bc89979195e7789b821'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:25.146595 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:25.152455 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-13a9055c-edd1-4fb4-a810-d1f1de14724a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111a699675094bc89979195e7789b821'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:25.159064 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 516/1044] 10.222.0.40 () {58 vars in 1224 bytes} [Sat Oct 29 20:52:24 2022] DELETE /identity/v3/users/111a699675094bc89979195e7789b821 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:52:25.332098 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 20:52:25.333663 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 20:52:25.344081 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:25.349213 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7830b76-ccaf-4f28-86c6-b5a9f8e810b1 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 20:52:25.411275 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9beafc3b84548cf9fb3d264e0f50848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed5676f4e9241dc85909bd15e1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 20:52:25.411928 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 20:52:25.412206 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 20:52:25.412476 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e admin admin] PATH_INFO: `/v3/projects/ebeba3500afa4d7b8453f94ba8ccfb37` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 20:52:25.413601 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebeba3500afa4d7b8453f94ba8ccfb37)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 20:52:25.415560 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 20:52:25.461237 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebeba3500afa4d7b8453f94ba8ccfb37', 'request_id': 'req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:25.467500 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebeba3500afa4d7b8453f94ba8ccfb37', 'request_id': 'req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:25.476262 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebeba3500afa4d7b8453f94ba8ccfb37', 'request_id': 'req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:25.487247 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e admin admin] The token cache is being invalidate because project ebeba3500afa4d7b8453f94ba8ccfb37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 20:52:25.487565 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:25.488191 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-fc0c3213-30db-4b76-8550-7ec2c21e1e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 20:52:25.489665 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 529/1045] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Oct 29 20:52:25 2022] DELETE /identity/v3/projects/ebeba3500afa4d7b8453f94ba8ccfb37 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 20:52:35.155734 dv-osbrick-master-4-ceph devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:35.483672 dv-osbrick-master-4-ceph devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}